2024-08-15T17:41:34.464 INFO:root:teuthology version: 1.2.0 2024-08-15T17:41:34.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-15T17:41:34.568 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7857029' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2c991c196a651f8ef0f36c7763ec87a241b25549 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2c991c196a651f8ef0f36c7763ec87a241b25549 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2c991c196a651f8ef0f36c7763ec87a241b25549 owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2c991c196a651f8ef0f36c7763ec87a241b25549 sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2c991c196a651f8ef0f36c7763ec87a241b25549 targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-15_16:39:12 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-15T17:41:34.569 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa; will attempt to use it 2024-08-15T17:41:34.569 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks 2024-08-15T17:41:34.569 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-15T17:41:34.571 INFO:teuthology.task.internal:Checking packages... 2024-08-15T17:41:34.593 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2c991c196a651f8ef0f36c7763ec87a241b25549' 2024-08-15T17:41:34.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-15T17:41:34.593 INFO:teuthology.packaging:ref: None 2024-08-15T17:41:34.593 INFO:teuthology.packaging:tag: None 2024-08-15T17:41:34.593 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-15T17:41:34.593 INFO:teuthology.packaging:sha1: 2c991c196a651f8ef0f36c7763ec87a241b25549 2024-08-15T17:41:34.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-15T17:41:34.739 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2c991c19-1focal 2024-08-15T17:41:34.741 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-15T17:41:34.749 INFO:teuthology.task.internal:no buildpackages task found 2024-08-15T17:41:34.749 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-15T17:41:34.757 INFO:teuthology.task.internal:Saving configuration 2024-08-15T17:41:34.777 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-15T17:41:34.784 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-15T17:41:34.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-15 17:35:29.587092', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-15T17:41:34.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-15 17:35:29.585367', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-15T17:41:34.826 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-15T17:41:34.832 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-15T17:41:34.833 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-15T17:41:34.833 INFO:teuthology.run_tasks:Running task console_log... 2024-08-15T17:41:34.887 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea32293ac0>, signals=[15]) 2024-08-15T17:41:34.887 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-15T17:41:34.893 INFO:teuthology.task.internal:Opening connections... 2024-08-15T17:41:34.893 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:41:34.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:41:34.986 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:41:34.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:41:35.080 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-15T17:41:35.087 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-08-15T17:41:35.094 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-08-15T17:41:35.094 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-08-15T17:41:35.140 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2024-08-15T17:41:35.140 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-15T17:41:35.140 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2024-08-15T17:41:35.140 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2024-08-15T17:41:35.140 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-15T17:41:35.140 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04" 2024-08-15T17:41:35.141 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-15T17:41:35.141 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-15T17:41:35.141 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-15T17:41:35.141 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-15T17:41:35.141 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal 2024-08-15T17:41:35.141 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal 2024-08-15T17:41:35.141 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-08-15T17:41:35.178 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-08-15T17:41:35.184 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-08-15T17:41:35.184 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-08-15T17:41:35.233 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2024-08-15T17:41:35.233 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal 2024-08-15T17:41:35.234 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal 2024-08-15T17:41:35.234 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-08-15T17:41:35.258 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-15T17:41:35.267 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-15T17:41:35.278 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-15T17:41:35.279 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-08-15T17:41:35.281 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-08-15T17:41:35.287 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-15T17:41:35.293 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-15T17:41:35.294 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-08-15T17:41:35.296 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-08-15T17:41:35.340 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-15T17:41:35.390 INFO:teuthology.run_tasks:Running task kernel... 2024-08-15T17:41:35.406 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-15T17:41:35.406 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-15T17:41:35.406 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-15T17:41:35.407 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-15T17:41:35.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:41:35.412 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-08-15T17:41:35.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:41:35.413 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-08-15T17:41:35.419 INFO:teuthology.orchestra.run.smithi033.stdout:5.4.0-124-generic 2024-08-15T17:41:35.419 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.4.0-124-generic 2024-08-15T17:41:35.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get clean 2024-08-15T17:41:35.421 INFO:teuthology.orchestra.run.smithi105.stdout:5.4.0-124-generic 2024-08-15T17:41:35.422 INFO:teuthology.task.kernel:Running kernel on smithi105: 5.4.0-124-generic 2024-08-15T17:41:35.422 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get clean 2024-08-15T17:41:35.503 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2024-08-15T17:41:35.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2024-08-15T17:41:35.673 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-15T17:41:35.789 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-15T17:41:35.789 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-15T17:41:35.789 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-15T17:41:35.839 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-15T17:41:35.871 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-15T17:41:35.974 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [796 kB] 2024-08-15T17:41:36.059 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,125 kB] 2024-08-15T17:41:36.100 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-15T17:41:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.1 kB] 2024-08-15T17:41:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-15T17:41:36.104 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-15T17:41:36.124 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-15T17:41:36.127 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-15T17:41:36.127 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-15T17:41:36.131 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-15T17:41:36.138 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-15T17:41:36.139 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.1 kB] 2024-08-15T17:41:36.139 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-15T17:41:36.139 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-15T17:41:36.140 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-15T17:41:36.152 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-15T17:41:36.192 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-15T17:41:36.223 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-15T17:41:36.268 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,125 kB] 2024-08-15T17:41:36.364 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,016 kB] 2024-08-15T17:41:36.414 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,495 kB] 2024-08-15T17:41:36.607 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,495 kB] 2024-08-15T17:41:36.773 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-15T17:41:36.787 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-15T17:41:36.787 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-15T17:41:36.788 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-15T17:41:36.800 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [796 kB] 2024-08-15T17:41:36.815 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-15T17:41:36.824 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.1 kB] 2024-08-15T17:41:36.824 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-15T17:41:36.875 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-15T17:41:36.878 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,016 kB] 2024-08-15T17:41:36.892 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-15T17:41:36.892 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-15T17:41:36.895 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-15T17:41:36.904 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-15T17:41:36.904 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-15T17:41:36.911 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-15T17:41:36.911 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-15T17:41:36.918 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-15T17:41:36.918 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-15T17:41:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-15T17:41:36.949 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-15T17:41:36.956 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-15T17:41:36.956 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-15T17:41:36.957 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-15T17:41:36.957 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-15T17:41:36.968 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-15T17:41:36.979 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-15T17:41:36.983 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.1 kB] 2024-08-15T17:41:36.983 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-15T17:41:36.984 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-15T17:41:36.993 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-15T17:41:36.994 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-15T17:41:37.001 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-15T17:41:37.001 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-15T17:41:37.018 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-15T17:41:37.018 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-15T17:41:37.019 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-15T17:41:37.020 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-15T17:41:37.051 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-15T17:41:37.059 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-15T17:41:37.060 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-15T17:41:37.069 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-15T17:41:37.075 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-15T17:41:37.076 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-15T17:41:37.076 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-15T17:41:37.099 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-15T17:41:37.100 INFO:teuthology.orchestra.run.smithi033.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-15T17:41:37.100 INFO:teuthology.orchestra.run.smithi033.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-15T17:41:37.140 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-15T17:41:37.141 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-15T17:41:37.141 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-15T17:41:37.141 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-15T17:41:37.142 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-15T17:41:37.222 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-15T17:41:37.222 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-15T17:41:37.222 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-15T17:41:40.487 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 21.4 MB in 3s (7,204 kB/s) 2024-08-15T17:41:41.109 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 21.4 MB in 4s (6,089 kB/s) 2024-08-15T17:41:42.105 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:41:42.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-15T17:41:42.216 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:41:42.438 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2024-08-15T17:41:42.439 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2024-08-15T17:41:42.654 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2024-08-15T17:41:42.654 INFO:teuthology.orchestra.run.smithi033.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-15T17:41:42.654 INFO:teuthology.orchestra.run.smithi033.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-15T17:41:42.654 INFO:teuthology.orchestra.run.smithi033.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-15T17:41:42.655 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2024-08-15T17:41:42.655 INFO:teuthology.orchestra.run.smithi033.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-15T17:41:42.655 INFO:teuthology.orchestra.run.smithi033.stdout:Recommended packages: 2024-08-15T17:41:42.656 INFO:teuthology.orchestra.run.smithi033.stdout: thermald 2024-08-15T17:41:42.698 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:41:42.726 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-15T17:41:42.727 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2024-08-15T17:41:42.727 INFO:teuthology.orchestra.run.smithi033.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-15T17:41:42.727 INFO:teuthology.orchestra.run.smithi033.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-15T17:41:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-15T17:41:42.729 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2024-08-15T17:41:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-15T17:41:42.802 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:41:42.914 INFO:teuthology.orchestra.run.smithi033.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-08-15T17:41:42.914 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 77.2 MB of archives. 2024-08-15T17:41:42.914 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-15T17:41:42.914 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-15T17:41:43.019 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2024-08-15T17:41:43.020 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2024-08-15T17:41:43.235 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2024-08-15T17:41:43.235 INFO:teuthology.orchestra.run.smithi105.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-15T17:41:43.235 INFO:teuthology.orchestra.run.smithi105.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-15T17:41:43.236 INFO:teuthology.orchestra.run.smithi105.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-15T17:41:43.236 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2024-08-15T17:41:43.237 INFO:teuthology.orchestra.run.smithi105.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-15T17:41:43.237 INFO:teuthology.orchestra.run.smithi105.stdout:Recommended packages: 2024-08-15T17:41:43.237 INFO:teuthology.orchestra.run.smithi105.stdout: thermald 2024-08-15T17:41:43.297 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2024-08-15T17:41:43.297 INFO:teuthology.orchestra.run.smithi105.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-15T17:41:43.297 INFO:teuthology.orchestra.run.smithi105.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-15T17:41:43.298 INFO:teuthology.orchestra.run.smithi105.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-15T17:41:43.299 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2024-08-15T17:41:43.300 INFO:teuthology.orchestra.run.smithi105.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-15T17:41:43.352 INFO:teuthology.orchestra.run.smithi105.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-08-15T17:41:43.353 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 77.2 MB of archives. 2024-08-15T17:41:43.353 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-15T17:41:43.353 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-15T17:41:43.650 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-15T17:41:43.742 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-15T17:41:44.086 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-15T17:41:44.195 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-15T17:41:44.196 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-15T17:41:44.196 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-15T17:41:44.288 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-15T17:41:44.298 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-15T17:41:44.360 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-15T17:41:44.964 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 77.2 MB in 1s (77.9 MB/s) 2024-08-15T17:41:45.173 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-15T17:41:45.721 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-15T17:41:45.721 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-15T17:41:45.722 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-15T17:41:46.003 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-15T17:41:46.048 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-15T17:41:46.805 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 77.2 MB in 3s (23.3 MB/s) 2024-08-15T17:41:46.929 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-15T17:41:46.934 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:41:47.054 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:41:47.129 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-15T17:41:48.819 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-15T17:41:48.825 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:41:48.954 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-15T17:41:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:41:48.970 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:41:49.065 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:41:50.132 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-15T17:41:50.145 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:41:50.182 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:41:50.960 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-15T17:41:50.975 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:41:51.079 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:41:52.197 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-15T17:41:52.213 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:41:52.255 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:41:55.011 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-15T17:41:55.163 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-15T17:41:55.830 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-15T17:41:55.974 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-15T17:41:56.335 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-15T17:41:56.351 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-15T17:41:56.393 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-15T17:41:57.345 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-15T17:41:57.463 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-15T17:41:57.856 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-15T17:41:57.983 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-15T17:41:58.629 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-15T17:41:58.645 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-15T17:41:58.688 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-15T17:42:01.751 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-15T17:42:01.772 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:42:01.809 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:04.525 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-15T17:42:04.563 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-15T17:42:04.585 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-15T17:42:04.638 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:04.678 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-15T17:42:05.016 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-15T17:42:05.141 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:06.368 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:07.469 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-15T17:42:07.538 INFO:teuthology.orchestra.run.smithi105.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-15T17:42:07.538 INFO:teuthology.orchestra.run.smithi105.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:07.598 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-15T17:42:07.695 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:07.821 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:07.962 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-15T17:42:08.120 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:09.014 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-15T17:42:09.140 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-15T17:42:09.266 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-15T17:42:09.409 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:09.483 INFO:teuthology.orchestra.run.smithi105.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-15T17:42:09.483 INFO:teuthology.orchestra.run.smithi105.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:09.930 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:11.133 INFO:teuthology.orchestra.run.smithi033.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-15T17:42:11.133 INFO:teuthology.orchestra.run.smithi033.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:11.306 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:11.433 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:12.684 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-15T17:42:12.835 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-15T17:42:12.961 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-15T17:42:13.121 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-15T17:42:13.186 INFO:teuthology.orchestra.run.smithi033.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-15T17:42:13.186 INFO:teuthology.orchestra.run.smithi033.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:32.150 INFO:teuthology.orchestra.run.smithi105.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-15T17:42:32.150 INFO:teuthology.orchestra.run.smithi105.stdout:Sourcing file `/etc/default/grub' 2024-08-15T17:42:32.166 INFO:teuthology.orchestra.run.smithi105.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-15T17:42:32.186 INFO:teuthology.orchestra.run.smithi105.stdout:Generating grub configuration file ... 2024-08-15T17:42:32.509 INFO:teuthology.orchestra.run.smithi105.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-15T17:42:32.535 INFO:teuthology.orchestra.run.smithi105.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:32.953 INFO:teuthology.orchestra.run.smithi105.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-15T17:42:32.965 INFO:teuthology.orchestra.run.smithi105.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-15T17:42:35.687 INFO:teuthology.orchestra.run.smithi033.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-15T17:42:35.687 INFO:teuthology.orchestra.run.smithi033.stdout:Sourcing file `/etc/default/grub' 2024-08-15T17:42:35.701 INFO:teuthology.orchestra.run.smithi033.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-15T17:42:35.714 INFO:teuthology.orchestra.run.smithi033.stdout:Generating grub configuration file ... 2024-08-15T17:42:35.745 INFO:teuthology.orchestra.run.smithi105.stdout:done 2024-08-15T17:42:36.054 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-15T17:42:36.073 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:36.197 DEBUG:teuthology.orchestra.run.smithi105:> dpkg -s linux-image-generic 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Package: linux-image-generic 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Status: install ok installed 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Priority: optional 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Section: kernel 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Installed-Size: 20 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Maintainer: Ubuntu Kernel Team 2024-08-15T17:42:36.241 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: amd64 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout:Source: linux-meta 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout:Version: 5.4.0.192.190 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout:Recommends: thermald 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout:Description: Generic Linux kernel image 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout: This package will always depend on the latest generic kernel image 2024-08-15T17:42:36.242 INFO:teuthology.orchestra.run.smithi105.stdout: available. 2024-08-15T17:42:36.242 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-15T17:42:36.243 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-15T17:42:36.243 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-15T17:42:36.243 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-15T17:42:36.243 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi105.front.sepia.ceph.com, path=None, version=distro) 2024-08-15T17:42:36.243 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get clean 2024-08-15T17:42:36.342 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2024-08-15T17:42:36.460 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-15T17:42:36.471 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-15T17:42:36.604 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-15T17:42:36.612 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-15T17:42:36.675 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-15T17:42:36.757 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-15T17:42:38.460 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:42:38.487 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-15T17:42:38.558 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:42:38.748 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2024-08-15T17:42:38.748 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2024-08-15T17:42:38.970 INFO:teuthology.orchestra.run.smithi105.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-15T17:42:38.970 INFO:teuthology.orchestra.run.smithi105.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-08-15T17:42:38.972 DEBUG:teuthology.orchestra.run.smithi105:> dpkg -s linux-image-generic 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Package: linux-image-generic 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Status: install ok installed 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Priority: optional 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Section: kernel 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Installed-Size: 20 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Maintainer: Ubuntu Kernel Team 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: amd64 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Source: linux-meta 2024-08-15T17:42:38.995 INFO:teuthology.orchestra.run.smithi105.stdout:Version: 5.4.0.192.190 2024-08-15T17:42:38.996 INFO:teuthology.orchestra.run.smithi105.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-15T17:42:38.996 INFO:teuthology.orchestra.run.smithi105.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-15T17:42:38.996 INFO:teuthology.orchestra.run.smithi105.stdout:Recommends: thermald 2024-08-15T17:42:38.996 INFO:teuthology.orchestra.run.smithi105.stdout:Description: Generic Linux kernel image 2024-08-15T17:42:38.996 INFO:teuthology.orchestra.run.smithi105.stdout: This package will always depend on the latest generic kernel image 2024-08-15T17:42:38.996 INFO:teuthology.orchestra.run.smithi105.stdout: available. 2024-08-15T17:42:38.996 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-08-15T17:42:39.003 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.AJBBBIXhpE 2024-08-15T17:42:39.003 DEBUG:teuthology.orchestra.run.smithi105:> sudo cp /boot/grub/grub.cfg /tmp/tmp.AJBBBIXhpE 2024-08-15T17:42:39.018 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.AJBBBIXhpE 2024-08-15T17:42:39.060 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.AJBBBIXhpE is 9KB 2024-08-15T17:42:39.074 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.AJBBBIXhpE 2024-08-15T17:42:39.080 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-15T17:42:39.140 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:42:39.140 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-15T17:42:39.140 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-15T17:42:39.175 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-15T17:42:39.175 DEBUG:teuthology.orchestra.run.smithi105:> sudo update-grub 2024-08-15T17:42:39.308 INFO:teuthology.orchestra.run.smithi033.stdout:done 2024-08-15T17:42:39.755 DEBUG:teuthology.orchestra.run.smithi033:> dpkg -s linux-image-generic 2024-08-15T17:42:39.805 INFO:teuthology.orchestra.run.smithi033.stdout:Package: linux-image-generic 2024-08-15T17:42:39.805 INFO:teuthology.orchestra.run.smithi033.stdout:Status: install ok installed 2024-08-15T17:42:39.805 INFO:teuthology.orchestra.run.smithi033.stdout:Priority: optional 2024-08-15T17:42:39.805 INFO:teuthology.orchestra.run.smithi033.stdout:Section: kernel 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Installed-Size: 20 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Maintainer: Ubuntu Kernel Team 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: amd64 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Source: linux-meta 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Version: 5.4.0.192.190 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Recommends: thermald 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout:Description: Generic Linux kernel image 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout: This package will always depend on the latest generic kernel image 2024-08-15T17:42:39.806 INFO:teuthology.orchestra.run.smithi033.stdout: available. 2024-08-15T17:42:39.806 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-15T17:42:39.807 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-15T17:42:39.807 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-15T17:42:39.807 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-15T17:42:39.807 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2024-08-15T17:42:39.807 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get clean 2024-08-15T17:42:39.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2024-08-15T17:42:40.178 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-15T17:42:40.178 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-15T17:42:40.247 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-15T17:42:40.336 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-15T17:42:40.616 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub' 2024-08-15T17:42:40.622 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-15T17:42:40.635 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2024-08-15T17:42:40.908 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-15T17:42:40.919 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:41.314 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-15T17:42:41.326 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-15T17:42:42.097 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:42:42.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-15T17:42:42.197 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:42:42.414 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2024-08-15T17:42:42.414 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2024-08-15T17:42:42.652 INFO:teuthology.orchestra.run.smithi033.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-15T17:42:42.652 INFO:teuthology.orchestra.run.smithi033.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-08-15T17:42:42.654 DEBUG:teuthology.orchestra.run.smithi033:> dpkg -s linux-image-generic 2024-08-15T17:42:42.677 INFO:teuthology.orchestra.run.smithi033.stdout:Package: linux-image-generic 2024-08-15T17:42:42.677 INFO:teuthology.orchestra.run.smithi033.stdout:Status: install ok installed 2024-08-15T17:42:42.677 INFO:teuthology.orchestra.run.smithi033.stdout:Priority: optional 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Section: kernel 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Installed-Size: 20 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Maintainer: Ubuntu Kernel Team 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: amd64 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Source: linux-meta 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Version: 5.4.0.192.190 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Recommends: thermald 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:Description: Generic Linux kernel image 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout: This package will always depend on the latest generic kernel image 2024-08-15T17:42:42.678 INFO:teuthology.orchestra.run.smithi033.stdout: available. 2024-08-15T17:42:42.679 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-08-15T17:42:42.684 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.OCbUWWPJwf 2024-08-15T17:42:42.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub/grub.cfg /tmp/tmp.OCbUWWPJwf 2024-08-15T17:42:42.740 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.OCbUWWPJwf 2024-08-15T17:42:42.779 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.OCbUWWPJwf is 9KB 2024-08-15T17:42:42.792 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.OCbUWWPJwf 2024-08-15T17:42:42.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-15T17:42:42.855 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:42:42.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-15T17:42:42.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-15T17:42:42.886 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-15T17:42:42.887 DEBUG:teuthology.orchestra.run.smithi033:> sudo update-grub 2024-08-15T17:42:43.028 INFO:teuthology.orchestra.run.smithi105.stderr:done 2024-08-15T17:42:43.030 DEBUG:teuthology.orchestra.run.smithi105:> sudo shutdown -r now 2024-08-15T17:42:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:Sourcing file `/etc/default/grub' 2024-08-15T17:42:44.333 INFO:teuthology.orchestra.run.smithi033.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-15T17:42:44.346 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-08-15T17:42:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-15T17:42:44.664 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-15T17:42:45.048 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-15T17:42:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-15T17:42:46.746 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-08-15T17:42:46.748 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-08-15T17:43:13.058 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-15T17:43:13.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:43:13.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:43:16.754 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-15T17:43:16.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-15T17:43:16.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:43:31.551 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-08-15T17:43:40.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:43:40.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:43:43.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-08-15T17:43:55.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:43:55.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:44:14.047 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-08-15T17:44:16.761 DEBUG:teuthology.orchestra.remote:timed out 2024-08-15T17:44:25.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-15T17:44:25.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:44:26.045 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-08-15T17:44:26.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-15T17:44:26.634 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-15T17:44:26.634 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-08-15T17:44:26.641 INFO:teuthology.orchestra.run.smithi033.stdout:5.4.0-192-generic 2024-08-15T17:44:26.641 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-15T17:44:26.641 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-15T17:44:26.642 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-15T17:44:27.644 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-15T17:44:27.685 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-15T17:44:27.779 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-08-15T17:44:27.810 DEBUG:teuthology.parallel:result is None 2024-08-15T17:44:29.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:44:29.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:44:29.450 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-08-15T17:44:30.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:44:30.358 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-15T17:44:30.358 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-08-15T17:44:30.365 INFO:teuthology.orchestra.run.smithi105.stdout:5.4.0-192-generic 2024-08-15T17:44:30.365 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-15T17:44:30.365 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-15T17:44:30.365 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-15T17:44:31.365 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-15T17:44:31.366 DEBUG:teuthology.orchestra.run.smithi105:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-15T17:44:31.469 INFO:teuthology.orchestra.run.smithi105.stdout:ttyS1 2024-08-15T17:44:31.495 DEBUG:teuthology.parallel:result is None 2024-08-15T17:44:31.496 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-15T17:44:31.506 INFO:teuthology.task.internal:Creating test directory... 2024-08-15T17:44:31.506 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-15T17:44:31.508 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-15T17:44:31.515 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-15T17:44:31.524 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-15T17:44:31.535 INFO:teuthology.task.internal:Creating archive directory... 2024-08-15T17:44:31.535 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-15T17:44:31.556 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-15T17:44:31.581 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-15T17:44:31.590 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-15T17:44:31.590 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-15T17:44:31.592 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-15T17:44:31.607 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-15T17:44:31.614 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-15T17:44:31.617 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-15T17:44:31.624 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-15T17:44:31.626 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-15T17:44:31.634 INFO:teuthology.task.internal:Configuring sudo... 2024-08-15T17:44:31.634 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-15T17:44:31.636 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-15T17:44:31.683 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-15T17:44:31.692 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-15T17:44:31.693 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-15T17:44:31.695 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-15T17:44:31.701 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-15T17:44:31.708 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-15T17:44:31.758 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:44:31.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-15T17:44:31.782 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-15T17:44:31.790 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-15T17:44:31.839 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:44:31.839 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-15T17:44:31.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-08-15T17:44:31.862 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-08-15T17:44:31.909 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-15T17:44:31.919 INFO:teuthology.task.internal:Starting timer... 2024-08-15T17:44:31.919 INFO:teuthology.run_tasks:Running task pcp... 2024-08-15T17:44:31.934 INFO:teuthology.run_tasks:Running task selinux... 2024-08-15T17:44:31.945 DEBUG:teuthology.task.selinux:Excluding smithi033: OS 'ubuntu' does not support SELinux 2024-08-15T17:44:31.946 DEBUG:teuthology.task.selinux:Excluding smithi105: OS 'ubuntu' does not support SELinux 2024-08-15T17:44:31.946 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-15T17:44:31.946 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-15T17:44:31.946 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-15T17:44:31.946 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-15T17:44:31.956 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-15T17:44:31.969 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-15T17:44:31.970 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-15T17:50:08.460 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2024-08-15T17:50:08.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-15T17:50:08.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:50:08.554 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-08-15T17:50:08.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-15T17:50:08.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:50:08.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-15T17:50:08.770 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-08-15T17:50:08.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-08-15T17:50:08.892 INFO:teuthology.run_tasks:Running task clock... 2024-08-15T17:50:08.902 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-15T17:50:08.903 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-15T17:50:08.903 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-15T17:50:08.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-15T17:50:08.906 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-15T17:50:08.937 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-15T17:50:08.937 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Command line: ntpd -gq 2024-08-15T17:50:08.938 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: proto: precision = 0.154 usec (-23) 2024-08-15T17:50:08.938 INFO:teuthology.orchestra.run.smithi033.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-15T17:50:08.939 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-15T17:50:08.939 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: restrict ::: KOD does nothing without LIMITED. 2024-08-15T17:50:08.939 INFO:teuthology.orchestra.run.smithi033.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-15T17:50:08.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listen and drop on 0 v6wildcard [::]:123 2024-08-15T17:50:08.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-15T17:50:08.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listen normally on 2 lo 127.0.0.1:123 2024-08-15T17:50:08.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listen normally on 3 ens1f0 172.21.15.33:123 2024-08-15T17:50:08.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listen normally on 4 lo [::1]:123 2024-08-15T17:50:08.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:d294%4]:123 2024-08-15T17:50:08.941 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:08 ntpd[13507]: Listening on routing socket on fd #22 for interface updates 2024-08-15T17:50:08.971 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-15T17:50:08.971 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Command line: ntpd -gq 2024-08-15T17:50:08.972 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: proto: precision = 0.117 usec (-23) 2024-08-15T17:50:08.972 INFO:teuthology.orchestra.run.smithi105.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-15T17:50:08.973 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-15T17:50:08.973 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: restrict ::: KOD does nothing without LIMITED. 2024-08-15T17:50:08.973 INFO:teuthology.orchestra.run.smithi105.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-15T17:50:08.974 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listen and drop on 0 v6wildcard [::]:123 2024-08-15T17:50:08.974 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-15T17:50:08.974 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listen normally on 2 lo 127.0.0.1:123 2024-08-15T17:50:08.974 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listen normally on 3 enp3s0f1 172.21.15.105:123 2024-08-15T17:50:08.974 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listen normally on 4 lo [::1]:123 2024-08-15T17:50:08.975 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d429%5]:123 2024-08-15T17:50:08.975 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:08 ntpd[13633]: Listening on routing socket on fd #22 for interface updates 2024-08-15T17:50:09.938 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:09.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:09 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:10.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:10.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:10.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:10 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:11 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:11.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:11 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:11 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:11 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:11.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:11 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:11.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:11 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:11.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:11 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:12.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:12.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:12 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:13 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:13.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:13.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:13.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:13.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:13 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:14.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:14.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:14.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:14 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:15.939 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:15.940 INFO:teuthology.orchestra.run.smithi033.stdout:15 Aug 17:50:15 ntpd[13507]: ntpd: time slew +0.001342 s 2024-08-15T17:50:15.940 INFO:teuthology.orchestra.run.smithi033.stdout:ntpd: time slew +0.001342s 2024-08-15T17:50:15.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-15T17:50:15.940 INFO:teuthology.orchestra.run.smithi033.stderr:15 Aug 17:50:15 ntpd[13507]: can't open /var/log/ntpstats/loopstats.20240815: Permission denied 2024-08-15T17:50:15.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:15 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:15.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:15 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:15.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:15 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:15.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:15 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:15.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:15 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:15.972 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:15 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:16.012 INFO:teuthology.orchestra.run.smithi033.stdout: remote refid st t when poll reach delay offset jitter 2024-08-15T17:50:16.012 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================== 2024-08-15T17:50:16.012 INFO:teuthology.orchestra.run.smithi033.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:16.012 INFO:teuthology.orchestra.run.smithi033.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:16.012 INFO:teuthology.orchestra.run.smithi033.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:16.012 INFO:teuthology.orchestra.run.smithi033.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240815: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-15T17:50:16.973 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240815: Permission denied 2024-08-15T17:50:16.974 INFO:teuthology.orchestra.run.smithi105.stdout:15 Aug 17:50:16 ntpd[13633]: ntpd: time slew +0.000645 s 2024-08-15T17:50:16.974 INFO:teuthology.orchestra.run.smithi105.stdout:ntpd: time slew +0.000645s 2024-08-15T17:50:16.974 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-15T17:50:16.974 INFO:teuthology.orchestra.run.smithi105.stderr:15 Aug 17:50:16 ntpd[13633]: can't open /var/log/ntpstats/loopstats.20240815: Permission denied 2024-08-15T17:50:17.037 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2024-08-15T17:50:17.037 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2024-08-15T17:50:17.037 INFO:teuthology.orchestra.run.smithi105.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:17.037 INFO:teuthology.orchestra.run.smithi105.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:17.037 INFO:teuthology.orchestra.run.smithi105.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:17.037 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:50:17.038 INFO:teuthology.run_tasks:Running task install... 2024-08-15T17:50:17.047 DEBUG:teuthology.task.install:project ceph 2024-08-15T17:50:17.047 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549'}} 2024-08-15T17:50:17.047 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549'} 2024-08-15T17:50:17.047 INFO:teuthology.task.install:Using flavor: default 2024-08-15T17:50:17.053 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-15T17:50:17.053 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-15T17:50:17.054 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-key list | grep Ceph 2024-08-15T17:50:17.054 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-key list | grep Ceph 2024-08-15T17:50:17.157 INFO:teuthology.orchestra.run.smithi105.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-15T17:50:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-15T17:50:17.217 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-15T17:50:17.217 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph.com (release key) 2024-08-15T17:50:17.218 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-15T17:50:17.218 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-15T17:50:17.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2c991c196a651f8ef0f36c7763ec87a241b25549 2024-08-15T17:50:17.225 INFO:teuthology.orchestra.run.smithi033.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-15T17:50:17.226 INFO:teuthology.orchestra.run.smithi033.stdout:uid [ unknown] Ceph.com (release key) 2024-08-15T17:50:17.226 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-15T17:50:17.226 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-15T17:50:17.226 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2c991c196a651f8ef0f36c7763ec87a241b25549 2024-08-15T17:50:17.375 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default/ 2024-08-15T17:50:17.375 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2c991c19-1focal 2024-08-15T17:50:17.380 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default/ 2024-08-15T17:50:17.380 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2c991c19-1focal 2024-08-15T17:50:17.490 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:50:17.491 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-15T17:50:17.501 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:50:17.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-15T17:50:17.507 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2024-08-15T17:50:17.517 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2024-08-15T17:50:17.661 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-15T17:50:17.693 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-15T17:50:17.715 INFO:teuthology.orchestra.run.smithi033.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal InRelease 2024-08-15T17:50:17.737 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-15T17:50:17.749 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal InRelease 2024-08-15T17:50:17.761 INFO:teuthology.orchestra.run.smithi033.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal Release.gpg 2024-08-15T17:50:17.771 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-15T17:50:17.778 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-15T17:50:17.783 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-15T17:50:17.794 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal Release.gpg 2024-08-15T17:50:17.809 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-15T17:50:17.815 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main i386 Packages [3,369 B] 2024-08-15T17:50:17.816 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-15T17:50:17.856 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main i386 Packages [3,369 B] 2024-08-15T17:50:17.860 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-15T17:50:17.892 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-15T17:50:17.942 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-15T17:50:17.979 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-15T17:50:18.333 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 28.4 kB in 1s (44.2 kB/s) 2024-08-15T17:50:18.356 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 28.4 kB in 1s (44.8 kB/s) 2024-08-15T17:50:19.485 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:50:19.510 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2c991c19-1focal cephadm=17.2.7-1375-g2c991c19-1focal ceph-mds=17.2.7-1375-g2c991c19-1focal ceph-mgr=17.2.7-1375-g2c991c19-1focal ceph-common=17.2.7-1375-g2c991c19-1focal ceph-fuse=17.2.7-1375-g2c991c19-1focal ceph-test=17.2.7-1375-g2c991c19-1focal ceph-volume=17.2.7-1375-g2c991c19-1focal radosgw=17.2.7-1375-g2c991c19-1focal python3-rados=17.2.7-1375-g2c991c19-1focal python3-rgw=17.2.7-1375-g2c991c19-1focal python3-cephfs=17.2.7-1375-g2c991c19-1focal python3-rbd=17.2.7-1375-g2c991c19-1focal libcephfs2=17.2.7-1375-g2c991c19-1focal libcephfs-dev=17.2.7-1375-g2c991c19-1focal librados2=17.2.7-1375-g2c991c19-1focal librbd1=17.2.7-1375-g2c991c19-1focal rbd-fuse=17.2.7-1375-g2c991c19-1focal python3-cephfs=17.2.7-1375-g2c991c19-1focal cephfs-shell=17.2.7-1375-g2c991c19-1focal cephfs-top=17.2.7-1375-g2c991c19-1focal cephfs-mirror=17.2.7-1375-g2c991c19-1focal 2024-08-15T17:50:19.522 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:50:19.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2c991c19-1focal cephadm=17.2.7-1375-g2c991c19-1focal ceph-mds=17.2.7-1375-g2c991c19-1focal ceph-mgr=17.2.7-1375-g2c991c19-1focal ceph-common=17.2.7-1375-g2c991c19-1focal ceph-fuse=17.2.7-1375-g2c991c19-1focal ceph-test=17.2.7-1375-g2c991c19-1focal ceph-volume=17.2.7-1375-g2c991c19-1focal radosgw=17.2.7-1375-g2c991c19-1focal python3-rados=17.2.7-1375-g2c991c19-1focal python3-rgw=17.2.7-1375-g2c991c19-1focal python3-cephfs=17.2.7-1375-g2c991c19-1focal python3-rbd=17.2.7-1375-g2c991c19-1focal libcephfs2=17.2.7-1375-g2c991c19-1focal libcephfs-dev=17.2.7-1375-g2c991c19-1focal librados2=17.2.7-1375-g2c991c19-1focal librbd1=17.2.7-1375-g2c991c19-1focal rbd-fuse=17.2.7-1375-g2c991c19-1focal python3-cephfs=17.2.7-1375-g2c991c19-1focal cephfs-shell=17.2.7-1375-g2c991c19-1focal cephfs-top=17.2.7-1375-g2c991c19-1focal cephfs-mirror=17.2.7-1375-g2c991c19-1focal 2024-08-15T17:50:19.583 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:50:19.628 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:50:19.798 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2024-08-15T17:50:19.798 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2024-08-15T17:50:19.850 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2024-08-15T17:50:19.850 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2024-08-15T17:50:19.988 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2024-08-15T17:50:19.989 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-15T17:50:19.989 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-15T17:50:19.989 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2024-08-15T17:50:19.989 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-15T17:50:19.989 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-15T17:50:19.991 INFO:teuthology.orchestra.run.smithi105.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-15T17:50:19.991 INFO:teuthology.orchestra.run.smithi105.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-15T17:50:19.991 INFO:teuthology.orchestra.run.smithi105.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-15T17:50:19.991 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-15T17:50:19.991 INFO:teuthology.orchestra.run.smithi105.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-15T17:50:19.991 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-15T17:50:19.992 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-15T17:50:19.993 INFO:teuthology.orchestra.run.smithi105.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-15T17:50:19.994 INFO:teuthology.orchestra.run.smithi105.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-15T17:50:19.994 INFO:teuthology.orchestra.run.smithi105.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-15T17:50:19.994 INFO:teuthology.orchestra.run.smithi105.stdout:Recommended packages: 2024-08-15T17:50:19.994 INFO:teuthology.orchestra.run.smithi105.stdout: btrfs-tools 2024-08-15T17:50:20.058 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-15T17:50:20.062 INFO:teuthology.orchestra.run.smithi033.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-15T17:50:20.063 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-15T17:50:20.064 INFO:teuthology.orchestra.run.smithi033.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout:Recommended packages: 2024-08-15T17:50:20.065 INFO:teuthology.orchestra.run.smithi033.stdout: btrfs-tools 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-15T17:50:20.115 INFO:teuthology.orchestra.run.smithi105.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-15T17:50:20.117 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-15T17:50:20.117 INFO:teuthology.orchestra.run.smithi105.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-15T17:50:20.117 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-15T17:50:20.117 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-15T17:50:20.118 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-15T17:50:20.119 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-15T17:50:20.119 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2024-08-15T17:50:20.119 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 librbd1 2024-08-15T17:50:20.191 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-15T17:50:20.192 INFO:teuthology.orchestra.run.smithi033.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-15T17:50:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-15T17:50:20.195 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2024-08-15T17:50:20.196 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 librbd1 2024-08-15T17:50:20.266 INFO:teuthology.orchestra.run.smithi105.stdout:2 upgraded, 114 newly installed, 0 to remove and 294 not upgraded. 2024-08-15T17:50:20.266 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 201 MB of archives. 2024-08-15T17:50:20.266 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-15T17:50:20.266 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2c991c19-1focal [3,507 kB] 2024-08-15T17:50:20.310 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-15T17:50:20.343 INFO:teuthology.orchestra.run.smithi033.stdout:2 upgraded, 114 newly installed, 0 to remove and 294 not upgraded. 2024-08-15T17:50:20.343 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 201 MB of archives. 2024-08-15T17:50:20.344 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-15T17:50:20.344 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2c991c19-1focal [3,507 kB] 2024-08-15T17:50:20.389 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-15T17:50:20.393 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-15T17:50:20.428 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-15T17:50:20.457 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2c991c19-1focal [3,557 kB] 2024-08-15T17:50:20.472 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-15T17:50:20.503 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-15T17:50:20.539 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2c991c19-1focal [761 kB] 2024-08-15T17:50:20.551 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2c991c19-1focal [414 kB] 2024-08-15T17:50:20.552 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-15T17:50:20.557 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2c991c19-1focal [22.6 kB] 2024-08-15T17:50:20.558 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2c991c19-1focal [200 kB] 2024-08-15T17:50:20.561 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2c991c19-1focal [49.1 kB] 2024-08-15T17:50:20.562 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2c991c19-1focal [390 kB] 2024-08-15T17:50:20.568 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2c991c19-1focal [5,612 kB] 2024-08-15T17:50:20.613 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2c991c19-1focal [3,557 kB] 2024-08-15T17:50:20.630 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-15T17:50:20.682 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-15T17:50:20.690 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-15T17:50:20.709 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2c991c19-1focal [116 kB] 2024-08-15T17:50:20.711 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2c991c19-1focal [479 kB] 2024-08-15T17:50:20.719 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2c991c19-1focal [26.9 MB] 2024-08-15T17:50:20.734 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-15T17:50:20.745 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-15T17:50:20.761 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-15T17:50:20.770 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-15T17:50:20.780 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2c991c19-1focal [761 kB] 2024-08-15T17:50:20.795 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2c991c19-1focal [414 kB] 2024-08-15T17:50:20.801 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2c991c19-1focal [22.6 kB] 2024-08-15T17:50:20.802 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2c991c19-1focal [200 kB] 2024-08-15T17:50:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-15T17:50:20.824 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-15T17:50:20.826 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-15T17:50:20.829 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-15T17:50:20.843 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2c991c19-1focal [49.1 kB] 2024-08-15T17:50:20.845 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2c991c19-1focal [390 kB] 2024-08-15T17:50:20.851 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2c991c19-1focal [5,612 kB] 2024-08-15T17:50:20.853 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-15T17:50:20.905 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-15T17:50:20.911 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-15T17:50:20.933 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-15T17:50:20.978 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-15T17:50:20.986 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-15T17:50:21.007 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-15T17:50:21.015 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-15T17:50:21.016 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-15T17:50:21.022 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-15T17:50:21.023 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-15T17:50:21.024 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-15T17:50:21.024 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-15T17:50:21.058 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-15T17:50:21.067 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-15T17:50:21.086 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-15T17:50:21.087 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-15T17:50:21.088 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-15T17:50:21.096 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-15T17:50:21.097 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-15T17:50:21.103 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-15T17:50:21.104 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-15T17:50:21.105 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-15T17:50:21.105 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-15T17:50:21.125 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2c991c19-1focal [116 kB] 2024-08-15T17:50:21.128 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2c991c19-1focal [479 kB] 2024-08-15T17:50:21.133 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2c991c19-1focal [26.9 MB] 2024-08-15T17:50:21.167 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-15T17:50:21.168 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-15T17:50:21.168 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-15T17:50:21.168 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-15T17:50:21.169 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-15T17:50:21.171 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-15T17:50:21.172 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-15T17:50:21.173 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-15T17:50:21.175 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-15T17:50:21.176 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-15T17:50:21.249 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-15T17:50:21.249 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-15T17:50:21.249 INFO:teuthology.orchestra.run.smithi105.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-15T17:50:21.249 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-15T17:50:21.251 INFO:teuthology.orchestra.run.smithi105.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-15T17:50:21.251 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-15T17:50:21.252 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-15T17:50:21.253 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-15T17:50:21.255 INFO:teuthology.orchestra.run.smithi033.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-15T17:50:21.256 INFO:teuthology.orchestra.run.smithi033.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-15T17:50:21.329 INFO:teuthology.orchestra.run.smithi033.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-15T17:50:21.330 INFO:teuthology.orchestra.run.smithi105.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-15T17:50:21.331 INFO:teuthology.orchestra.run.smithi033.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-15T17:50:21.339 INFO:teuthology.orchestra.run.smithi105.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-15T17:50:21.340 INFO:teuthology.orchestra.run.smithi105.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-15T17:50:21.341 INFO:teuthology.orchestra.run.smithi105.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-15T17:50:21.343 INFO:teuthology.orchestra.run.smithi105.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-15T17:50:21.344 INFO:teuthology.orchestra.run.smithi105.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-15T17:50:21.346 INFO:teuthology.orchestra.run.smithi105.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-15T17:50:21.347 INFO:teuthology.orchestra.run.smithi105.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-15T17:50:21.411 INFO:teuthology.orchestra.run.smithi033.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-15T17:50:21.411 INFO:teuthology.orchestra.run.smithi105.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-15T17:50:21.413 INFO:teuthology.orchestra.run.smithi105.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-15T17:50:21.419 INFO:teuthology.orchestra.run.smithi033.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-15T17:50:21.420 INFO:teuthology.orchestra.run.smithi033.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-15T17:50:21.421 INFO:teuthology.orchestra.run.smithi033.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-15T17:50:21.422 INFO:teuthology.orchestra.run.smithi033.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-15T17:50:21.425 INFO:teuthology.orchestra.run.smithi033.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-15T17:50:21.427 INFO:teuthology.orchestra.run.smithi033.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-15T17:50:21.428 INFO:teuthology.orchestra.run.smithi033.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-15T17:50:21.492 INFO:teuthology.orchestra.run.smithi033.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-15T17:50:21.492 INFO:teuthology.orchestra.run.smithi105.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-15T17:50:21.495 INFO:teuthology.orchestra.run.smithi033.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-15T17:50:21.556 INFO:teuthology.orchestra.run.smithi105.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-15T17:50:21.557 INFO:teuthology.orchestra.run.smithi105.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-15T17:50:21.575 INFO:teuthology.orchestra.run.smithi033.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-15T17:50:21.575 INFO:teuthology.orchestra.run.smithi033.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-15T17:50:21.576 INFO:teuthology.orchestra.run.smithi033.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-15T17:50:21.577 INFO:teuthology.orchestra.run.smithi033.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-15T17:50:21.617 INFO:teuthology.orchestra.run.smithi105.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-15T17:50:21.617 INFO:teuthology.orchestra.run.smithi105.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2c991c19-1focal [5,175 kB] 2024-08-15T17:50:21.685 INFO:teuthology.orchestra.run.smithi105.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2c991c19-1focal [223 kB] 2024-08-15T17:50:21.687 INFO:teuthology.orchestra.run.smithi105.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2c991c19-1focal [157 kB] 2024-08-15T17:50:21.690 INFO:teuthology.orchestra.run.smithi105.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2c991c19-1focal [1,594 kB] 2024-08-15T17:50:21.739 INFO:teuthology.orchestra.run.smithi105.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2c991c19-1focal [4,687 kB] 2024-08-15T17:50:21.878 INFO:teuthology.orchestra.run.smithi105.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2c991c19-1focal [23.1 MB] 2024-08-15T17:50:21.891 INFO:teuthology.orchestra.run.smithi105.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-15T17:50:21.915 INFO:teuthology.orchestra.run.smithi033.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-15T17:50:21.938 INFO:teuthology.orchestra.run.smithi033.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-15T17:50:21.939 INFO:teuthology.orchestra.run.smithi033.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-15T17:50:21.968 INFO:teuthology.orchestra.run.smithi105.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-15T17:50:21.969 INFO:teuthology.orchestra.run.smithi105.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-15T17:50:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-15T17:50:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-15T17:50:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-15T17:50:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-15T17:50:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-15T17:50:22.014 INFO:teuthology.orchestra.run.smithi033.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-15T17:50:22.014 INFO:teuthology.orchestra.run.smithi033.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-15T17:50:22.028 INFO:teuthology.orchestra.run.smithi105.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-15T17:50:22.028 INFO:teuthology.orchestra.run.smithi105.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-15T17:50:22.036 INFO:teuthology.orchestra.run.smithi105.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-15T17:50:22.037 INFO:teuthology.orchestra.run.smithi105.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-15T17:50:22.038 INFO:teuthology.orchestra.run.smithi105.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-15T17:50:22.038 INFO:teuthology.orchestra.run.smithi105.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-15T17:50:22.039 INFO:teuthology.orchestra.run.smithi105.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-15T17:50:22.065 INFO:teuthology.orchestra.run.smithi105.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-15T17:50:22.066 INFO:teuthology.orchestra.run.smithi105.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-15T17:50:22.141 INFO:teuthology.orchestra.run.smithi033.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-15T17:50:22.146 INFO:teuthology.orchestra.run.smithi105.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-15T17:50:22.151 INFO:teuthology.orchestra.run.smithi105.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-15T17:50:22.155 INFO:teuthology.orchestra.run.smithi105.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-15T17:50:22.159 INFO:teuthology.orchestra.run.smithi105.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-15T17:50:22.160 INFO:teuthology.orchestra.run.smithi033.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-15T17:50:22.160 INFO:teuthology.orchestra.run.smithi105.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-15T17:50:22.161 INFO:teuthology.orchestra.run.smithi033.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-15T17:50:22.162 INFO:teuthology.orchestra.run.smithi033.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2c991c19-1focal [5,175 kB] 2024-08-15T17:50:22.162 INFO:teuthology.orchestra.run.smithi105.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-15T17:50:22.165 INFO:teuthology.orchestra.run.smithi105.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-15T17:50:22.165 INFO:teuthology.orchestra.run.smithi105.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-15T17:50:22.166 INFO:teuthology.orchestra.run.smithi033.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-15T17:50:22.240 INFO:teuthology.orchestra.run.smithi033.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-15T17:50:22.241 INFO:teuthology.orchestra.run.smithi105.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-15T17:50:22.243 INFO:teuthology.orchestra.run.smithi033.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-15T17:50:22.245 INFO:teuthology.orchestra.run.smithi033.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-15T17:50:22.245 INFO:teuthology.orchestra.run.smithi105.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-15T17:50:22.251 INFO:teuthology.orchestra.run.smithi033.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-15T17:50:22.255 INFO:teuthology.orchestra.run.smithi033.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-15T17:50:22.255 INFO:teuthology.orchestra.run.smithi033.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-15T17:50:22.269 INFO:teuthology.orchestra.run.smithi033.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-15T17:50:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2c991c19-1focal [223 kB] 2024-08-15T17:50:22.321 INFO:teuthology.orchestra.run.smithi033.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2c991c19-1focal [157 kB] 2024-08-15T17:50:22.324 INFO:teuthology.orchestra.run.smithi033.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-15T17:50:22.324 INFO:teuthology.orchestra.run.smithi033.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2c991c19-1focal [1,594 kB] 2024-08-15T17:50:22.369 INFO:teuthology.orchestra.run.smithi033.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2c991c19-1focal [4,687 kB] 2024-08-15T17:50:22.404 INFO:teuthology.orchestra.run.smithi105.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-15T17:50:22.406 INFO:teuthology.orchestra.run.smithi105.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-15T17:50:22.407 INFO:teuthology.orchestra.run.smithi105.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-15T17:50:22.407 INFO:teuthology.orchestra.run.smithi105.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-15T17:50:22.407 INFO:teuthology.orchestra.run.smithi105.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-15T17:50:22.408 INFO:teuthology.orchestra.run.smithi105.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-15T17:50:22.421 INFO:teuthology.orchestra.run.smithi105.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-15T17:50:22.422 INFO:teuthology.orchestra.run.smithi105.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-15T17:50:22.450 INFO:teuthology.orchestra.run.smithi105.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-15T17:50:22.488 INFO:teuthology.orchestra.run.smithi105.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-15T17:50:22.525 INFO:teuthology.orchestra.run.smithi033.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-15T17:50:22.526 INFO:teuthology.orchestra.run.smithi033.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-15T17:50:22.526 INFO:teuthology.orchestra.run.smithi033.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-15T17:50:22.527 INFO:teuthology.orchestra.run.smithi033.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-15T17:50:22.527 INFO:teuthology.orchestra.run.smithi033.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-15T17:50:22.528 INFO:teuthology.orchestra.run.smithi033.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-15T17:50:22.569 INFO:teuthology.orchestra.run.smithi105.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-15T17:50:22.583 INFO:teuthology.orchestra.run.smithi033.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2c991c19-1focal [23.1 MB] 2024-08-15T17:50:22.588 INFO:teuthology.orchestra.run.smithi105.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-15T17:50:22.589 INFO:teuthology.orchestra.run.smithi105.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2c991c19-1focal [3,944 B] 2024-08-15T17:50:22.589 INFO:teuthology.orchestra.run.smithi105.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2c991c19-1focal [872 kB] 2024-08-15T17:50:22.592 INFO:teuthology.orchestra.run.smithi105.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-15T17:50:22.593 INFO:teuthology.orchestra.run.smithi105.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-15T17:50:22.594 INFO:teuthology.orchestra.run.smithi033.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-15T17:50:22.595 INFO:teuthology.orchestra.run.smithi033.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-15T17:50:22.595 INFO:teuthology.orchestra.run.smithi033.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-15T17:50:22.607 INFO:teuthology.orchestra.run.smithi033.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-15T17:50:22.638 INFO:teuthology.orchestra.run.smithi105.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2c991c19-1focal [2,416 kB] 2024-08-15T17:50:22.660 INFO:teuthology.orchestra.run.smithi105.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2c991c19-1focal [81.4 kB] 2024-08-15T17:50:22.660 INFO:teuthology.orchestra.run.smithi105.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2c991c19-1focal [120 kB] 2024-08-15T17:50:22.662 INFO:teuthology.orchestra.run.smithi105.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2c991c19-1focal [6,653 kB] 2024-08-15T17:50:22.688 INFO:teuthology.orchestra.run.smithi033.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-15T17:50:22.689 INFO:teuthology.orchestra.run.smithi033.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-15T17:50:22.692 INFO:teuthology.orchestra.run.smithi033.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-15T17:50:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-15T17:50:22.827 INFO:teuthology.orchestra.run.smithi105.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2c991c19-1focal [7,863 kB] 2024-08-15T17:50:23.045 INFO:teuthology.orchestra.run.smithi105.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2c991c19-1focal [4,060 B] 2024-08-15T17:50:23.045 INFO:teuthology.orchestra.run.smithi105.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2c991c19-1focal [53.3 MB] 2024-08-15T17:50:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2c991c19-1focal [3,944 B] 2024-08-15T17:50:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2c991c19-1focal [872 kB] 2024-08-15T17:50:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2c991c19-1focal [2,416 kB] 2024-08-15T17:50:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2c991c19-1focal [81.4 kB] 2024-08-15T17:50:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2c991c19-1focal [120 kB] 2024-08-15T17:50:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2c991c19-1focal [6,653 kB] 2024-08-15T17:50:23.817 INFO:teuthology.orchestra.run.smithi033.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2c991c19-1focal [7,863 kB] 2024-08-15T17:50:24.130 INFO:teuthology.orchestra.run.smithi033.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2c991c19-1focal [4,060 B] 2024-08-15T17:50:24.130 INFO:teuthology.orchestra.run.smithi033.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2c991c19-1focal [53.3 MB] 2024-08-15T17:50:24.796 INFO:teuthology.orchestra.run.smithi105.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2c991c19-1focal [230 kB] 2024-08-15T17:50:24.800 INFO:teuthology.orchestra.run.smithi105.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2c991c19-1focal [241 kB] 2024-08-15T17:50:24.804 INFO:teuthology.orchestra.run.smithi105.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2c991c19-1focal [22.0 kB] 2024-08-15T17:50:24.805 INFO:teuthology.orchestra.run.smithi105.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2c991c19-1focal [13.1 kB] 2024-08-15T17:50:24.806 INFO:teuthology.orchestra.run.smithi105.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2c991c19-1focal [21.9 kB] 2024-08-15T17:50:24.806 INFO:teuthology.orchestra.run.smithi105.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2c991c19-1focal [17.1 MB] 2024-08-15T17:50:25.320 INFO:teuthology.orchestra.run.smithi105.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2c991c19-1focal [80.9 kB] 2024-08-15T17:50:25.762 INFO:teuthology.orchestra.run.smithi033.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2c991c19-1focal [230 kB] 2024-08-15T17:50:25.767 INFO:teuthology.orchestra.run.smithi033.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2c991c19-1focal [241 kB] 2024-08-15T17:50:25.773 INFO:teuthology.orchestra.run.smithi033.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2c991c19-1focal [22.0 kB] 2024-08-15T17:50:25.774 INFO:teuthology.orchestra.run.smithi033.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2c991c19-1focal [13.1 kB] 2024-08-15T17:50:25.817 INFO:teuthology.orchestra.run.smithi033.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2c991c19-1focal [21.9 kB] 2024-08-15T17:50:25.818 INFO:teuthology.orchestra.run.smithi033.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2c991c19-1focal [17.1 MB] 2024-08-15T17:50:25.983 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 201 MB in 5s (38.7 MB/s) 2024-08-15T17:50:26.107 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-15T17:50:26.134 INFO:teuthology.orchestra.run.smithi033.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2c991c196a651f8ef0f36c7763ec87a241b25549/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2c991c19-1focal [80.9 kB] 2024-08-15T17:50:26.166 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-15T17:50:26.170 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-15T17:50:26.214 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-15T17:50:26.583 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-15T17:50:26.601 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-15T17:50:26.641 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-15T17:50:26.803 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 201 MB in 6s (33.9 MB/s) 2024-08-15T17:50:26.936 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-15T17:50:26.978 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cmd2. 2024-08-15T17:50:26.994 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-15T17:50:26.996 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-15T17:50:27.001 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-15T17:50:27.036 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-15T17:50:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-15T17:50:27.379 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-15T17:50:27.380 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-15T17:50:27.397 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-15T17:50:27.397 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-15T17:50:27.437 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-15T17:50:27.497 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-15T17:50:27.716 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cmd2. 2024-08-15T17:50:27.734 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-15T17:50:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-15T17:50:27.845 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:27.968 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librbd1 (17.2.7-1375-g2c991c19-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-15T17:50:28.310 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-15T17:50:28.328 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-15T17:50:28.409 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-15T17:50:28.716 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:28.781 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:28.839 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librados2 (17.2.7-1375-g2c991c19-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-15T17:50:28.905 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librbd1 (17.2.7-1375-g2c991c19-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-15T17:50:29.493 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs2. 2024-08-15T17:50:29.512 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:29.585 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:29.592 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:29.743 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librados2 (17.2.7-1375-g2c991c19-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-15T17:50:29.987 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rados. 2024-08-15T17:50:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:30.045 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rados (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:30.382 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-15T17:50:30.398 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:30.432 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:30.563 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libcephfs2. 2024-08-15T17:50:30.580 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:30.642 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libcephfs2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:30.700 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cephfs. 2024-08-15T17:50:30.717 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:30.759 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cephfs (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:30.932 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rados. 2024-08-15T17:50:30.949 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:30.997 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rados (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:31.113 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-15T17:50:31.132 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:31.172 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:31.377 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-15T17:50:31.393 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:31.435 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:31.506 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-prettytable. 2024-08-15T17:50:31.523 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-15T17:50:31.565 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-15T17:50:31.712 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cephfs. 2024-08-15T17:50:31.728 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:31.770 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cephfs (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:31.850 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rbd. 2024-08-15T17:50:31.866 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:31.909 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rbd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:32.132 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-15T17:50:32.147 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:32.189 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:32.320 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-15T17:50:32.336 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-15T17:50:32.378 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-15T17:50:32.484 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-prettytable. 2024-08-15T17:50:32.503 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-15T17:50:32.554 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-15T17:50:32.706 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-15T17:50:32.722 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-15T17:50:32.764 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-15T17:50:32.795 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rbd. 2024-08-15T17:50:32.812 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:32.853 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rbd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:33.126 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-15T17:50:33.142 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-15T17:50:33.209 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-15T17:50:33.231 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-15T17:50:33.248 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-15T17:50:33.289 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-15T17:50:33.621 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-15T17:50:33.638 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-15T17:50:33.668 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-15T17:50:33.679 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-15T17:50:33.684 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-15T17:50:33.726 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-15T17:50:33.973 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-15T17:50:33.990 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-15T17:50:34.058 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-15T17:50:34.079 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-15T17:50:34.096 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-15T17:50:34.137 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-15T17:50:34.440 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-15T17:50:34.457 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-15T17:50:34.507 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-15T17:50:34.569 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-15T17:50:34.586 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-15T17:50:34.690 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:50:34.834 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-15T17:50:34.854 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-15T17:50:34.892 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-15T17:50:35.197 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-15T17:50:35.214 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-15T17:50:35.281 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:50:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-15T17:50:35.464 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-15T17:50:35.523 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:50:35.642 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-15T17:50:35.658 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-15T17:50:35.700 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:50:35.982 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-15T17:50:36.000 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-15T17:50:36.032 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:50:36.111 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-15T17:50:36.127 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-15T17:50:36.186 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-15T17:50:36.419 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-15T17:50:36.439 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-15T17:50:36.477 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:50:36.564 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librgw2. 2024-08-15T17:50:36.582 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:36.622 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librgw2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:36.997 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-15T17:50:37.015 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-15T17:50:37.055 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-15T17:50:37.383 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rgw. 2024-08-15T17:50:37.401 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:37.433 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:37.566 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librgw2. 2024-08-15T17:50:37.585 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:37.617 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librgw2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:37.786 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liboath0. 2024-08-15T17:50:37.804 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-15T17:50:37.844 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-15T17:50:38.189 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libradosstriper1. 2024-08-15T17:50:38.206 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:38.263 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:38.419 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rgw. 2024-08-15T17:50:38.436 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:38.477 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:38.700 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-common. 2024-08-15T17:50:38.718 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:38.750 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:38.871 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liboath0. 2024-08-15T17:50:38.888 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-15T17:50:38.929 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-15T17:50:39.190 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libradosstriper1. 2024-08-15T17:50:39.206 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:39.240 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:39.669 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-common. 2024-08-15T17:50:39.685 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:39.727 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:41.289 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-base. 2024-08-15T17:50:41.306 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:41.357 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-base (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:42.285 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cryptography. 2024-08-15T17:50:42.302 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-15T17:50:42.315 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-base. 2024-08-15T17:50:42.333 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:42.368 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-15T17:50:42.384 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-base (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:42.780 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-openssl. 2024-08-15T17:50:42.798 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-15T17:50:42.838 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-15T17:50:43.191 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-packaging. 2024-08-15T17:50:43.211 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-15T17:50:43.249 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-15T17:50:43.295 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cryptography. 2024-08-15T17:50:43.314 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-15T17:50:43.353 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-15T17:50:43.511 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-15T17:50:43.526 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:43.594 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:43.698 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-openssl. 2024-08-15T17:50:43.716 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-15T17:50:43.781 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-15T17:50:43.957 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-15T17:50:43.974 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-15T17:50:44.015 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-15T17:50:44.101 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-packaging. 2024-08-15T17:50:44.117 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-15T17:50:44.159 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-15T17:50:44.301 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-15T17:50:44.320 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-15T17:50:44.360 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-15T17:50:44.445 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-15T17:50:44.461 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:44.503 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:44.680 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-natsort. 2024-08-15T17:50:44.695 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-15T17:50:44.758 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-15T17:50:44.975 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-15T17:50:44.994 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-15T17:50:45.041 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-15T17:50:45.066 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jwt. 2024-08-15T17:50:45.084 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-15T17:50:45.124 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-15T17:50:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-15T17:50:45.385 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-15T17:50:45.427 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-15T17:50:45.469 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-logutils. 2024-08-15T17:50:45.486 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-15T17:50:45.527 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-15T17:50:45.772 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-natsort. 2024-08-15T17:50:45.791 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-15T17:50:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-15T17:50:45.864 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-15T17:50:45.883 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-15T17:50:45.947 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-15T17:50:46.125 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jwt. 2024-08-15T17:50:46.144 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-15T17:50:46.200 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-15T17:50:46.233 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-mako. 2024-08-15T17:50:46.250 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-15T17:50:46.283 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-15T17:50:46.511 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-logutils. 2024-08-15T17:50:46.528 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-15T17:50:46.570 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-15T17:50:46.636 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-15T17:50:46.654 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-15T17:50:46.694 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-15T17:50:46.864 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-15T17:50:46.883 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-15T17:50:46.914 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-15T17:50:47.022 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-15T17:50:47.038 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-15T17:50:47.080 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-15T17:50:47.233 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-mako. 2024-08-15T17:50:47.252 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-15T17:50:47.291 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-15T17:50:47.450 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webob. 2024-08-15T17:50:47.466 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-15T17:50:47.508 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-15T17:50:47.645 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-15T17:50:47.664 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-15T17:50:47.703 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-15T17:50:47.886 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-15T17:50:47.902 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-15T17:50:47.944 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-15T17:50:48.006 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-15T17:50:48.022 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-15T17:50:48.064 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-15T17:50:48.297 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bs4. 2024-08-15T17:50:48.313 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-15T17:50:48.355 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-15T17:50:48.383 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webob. 2024-08-15T17:50:48.403 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-15T17:50:48.450 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-15T17:50:48.733 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-waitress. 2024-08-15T17:50:48.750 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-15T17:50:48.795 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-15T17:50:48.803 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-15T17:50:48.818 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-15T17:50:48.853 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-15T17:50:49.145 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-tempita. 2024-08-15T17:50:49.147 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-bs4. 2024-08-15T17:50:49.164 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-15T17:50:49.165 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-15T17:50:49.197 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-15T17:50:49.236 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-15T17:50:49.508 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-waitress. 2024-08-15T17:50:49.525 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-15T17:50:49.573 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-paste. 2024-08-15T17:50:49.589 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-15T17:50:49.620 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-15T17:50:49.631 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-15T17:50:49.903 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-tempita. 2024-08-15T17:50:49.919 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-15T17:50:49.961 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-15T17:50:49.984 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-15T17:50:50.001 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-15T17:50:50.261 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-paste. 2024-08-15T17:50:50.280 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-15T17:50:50.311 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-15T17:50:50.509 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-15T17:50:50.648 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-15T17:50:50.667 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-15T17:50:50.706 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-15T17:50:51.025 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-15T17:50:51.041 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-15T17:50:51.083 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-15T17:50:51.119 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-15T17:50:51.135 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-15T17:50:51.169 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-15T17:50:51.395 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webtest. 2024-08-15T17:50:51.411 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-15T17:50:51.472 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webtest. 2024-08-15T17:50:51.476 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-15T17:50:51.487 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-15T17:50:51.564 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-15T17:50:51.797 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pecan. 2024-08-15T17:50:51.814 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-15T17:50:51.855 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-15T17:50:51.900 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pecan. 2024-08-15T17:50:51.918 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-15T17:50:51.958 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-15T17:50:52.244 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-15T17:50:52.261 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-15T17:50:52.302 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-15T17:50:52.340 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-15T17:50:52.360 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-15T17:50:52.398 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-15T17:50:52.793 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-15T17:50:52.812 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:52.851 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:52.906 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-15T17:50:52.924 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:53.229 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr. 2024-08-15T17:50:53.246 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:53.287 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:53.380 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:53.799 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mon. 2024-08-15T17:50:53.817 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:53.857 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mon (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:53.886 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr. 2024-08-15T17:50:53.904 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:53.945 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:54.440 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mon. 2024-08-15T17:50:54.457 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:54.523 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mon (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:54.698 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-osd. 2024-08-15T17:50:54.714 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:54.756 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-osd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:55.369 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-osd. 2024-08-15T17:50:55.385 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:55.467 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-osd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:56.904 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph. 2024-08-15T17:50:56.922 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:56.967 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:57.295 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-fuse. 2024-08-15T17:50:57.313 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:57.653 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph. 2024-08-15T17:50:57.672 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:57.712 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:57.839 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mds. 2024-08-15T17:50:57.854 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:57.905 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mds (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:58.039 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-fuse. 2024-08-15T17:50:58.058 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:58.097 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:58.517 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephadm. 2024-08-15T17:50:58.534 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:58.550 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mds. 2024-08-15T17:50:58.567 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:58.574 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:58.659 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mds (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:58.919 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jinja2. 2024-08-15T17:50:58.935 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-15T17:50:58.977 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-15T17:50:59.187 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephadm. 2024-08-15T17:50:59.207 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:50:59.246 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:59.298 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-15T17:50:59.317 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:50:59.381 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:50:59.590 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jinja2. 2024-08-15T17:50:59.606 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-15T17:50:59.648 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-15T17:50:59.717 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-15T17:50:59.733 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-15T17:50:59.767 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-15T17:50:59.959 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-15T17:50:59.979 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:00.019 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:00.028 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-underscore. 2024-08-15T17:51:00.043 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-15T17:51:00.086 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-15T17:51:00.364 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-15T17:51:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-15T17:51:00.389 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-15T17:51:00.406 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-15T17:51:00.414 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-15T17:51:00.447 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-15T17:51:00.675 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjs-underscore. 2024-08-15T17:51:00.692 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-15T17:51:00.748 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-15T17:51:00.750 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-routes. 2024-08-15T17:51:00.766 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-15T17:51:00.825 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-15T17:51:01.035 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-15T17:51:01.052 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-15T17:51:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-15T17:51:01.203 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-15T17:51:01.229 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:01.261 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:01.446 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-routes. 2024-08-15T17:51:01.463 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-15T17:51:01.513 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-15T17:51:01.866 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-15T17:51:01.882 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:01.924 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:02.642 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-decorator. 2024-08-15T17:51:02.661 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-15T17:51:02.711 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-15T17:51:03.036 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-15T17:51:03.055 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-15T17:51:03.094 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-15T17:51:03.288 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-decorator. 2024-08-15T17:51:03.305 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-15T17:51:03.346 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-15T17:51:03.422 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-scipy. 2024-08-15T17:51:03.438 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-15T17:51:03.480 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-15T17:51:03.673 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-15T17:51:03.692 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-15T17:51:03.740 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-15T17:51:04.051 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-scipy. 2024-08-15T17:51:04.067 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-15T17:51:04.109 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-15T17:51:04.856 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-15T17:51:04.876 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-15T17:51:04.914 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:05.469 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-joblib. 2024-08-15T17:51:05.486 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-15T17:51:05.527 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-15T17:51:05.527 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-15T17:51:05.546 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-15T17:51:05.585 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:05.939 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn. 2024-08-15T17:51:05.955 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-15T17:51:05.997 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:06.139 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-joblib. 2024-08-15T17:51:06.159 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-15T17:51:06.197 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-15T17:51:06.693 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-sklearn. 2024-08-15T17:51:06.709 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-15T17:51:06.750 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:07.072 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-15T17:51:07.090 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:07.130 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:07.442 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-15T17:51:07.458 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:07.500 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:08.342 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cachetools. 2024-08-15T17:51:08.361 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-15T17:51:08.400 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-15T17:51:08.620 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cachetools. 2024-08-15T17:51:08.640 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-15T17:51:08.678 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-15T17:51:08.736 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-15T17:51:08.752 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-15T17:51:08.819 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-15T17:51:09.164 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-15T17:51:09.184 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-15T17:51:09.223 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-15T17:51:09.265 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-15T17:51:09.282 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-15T17:51:09.323 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-15T17:51:09.625 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rsa. 2024-08-15T17:51:09.626 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-15T17:51:09.642 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-15T17:51:09.643 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-15T17:51:09.676 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-15T17:51:09.709 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-15T17:51:09.969 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rsa. 2024-08-15T17:51:09.988 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-15T17:51:10.028 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-15T17:51:10.054 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-google-auth. 2024-08-15T17:51:10.070 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-15T17:51:10.111 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-15T17:51:10.340 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-google-auth. 2024-08-15T17:51:10.357 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-15T17:51:10.398 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-15T17:51:10.473 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-blinker. 2024-08-15T17:51:10.491 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-15T17:51:10.535 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-15T17:51:10.751 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-blinker. 2024-08-15T17:51:10.769 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-15T17:51:10.809 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-15T17:51:10.867 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-15T17:51:10.886 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-15T17:51:10.942 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-15T17:51:11.146 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-15T17:51:11.162 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-15T17:51:11.204 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-15T17:51:11.373 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-15T17:51:11.393 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-15T17:51:11.439 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-15T17:51:11.635 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-15T17:51:11.652 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-15T17:51:11.693 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-15T17:51:11.752 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-websocket. 2024-08-15T17:51:11.768 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-15T17:51:11.835 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-15T17:51:12.038 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-websocket. 2024-08-15T17:51:12.057 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-15T17:51:12.096 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-15T17:51:12.175 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-15T17:51:12.188 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-15T17:51:12.230 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-15T17:51:12.426 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-15T17:51:12.442 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-15T17:51:12.484 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-15T17:51:12.836 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-15T17:51:12.856 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:12.894 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:13.047 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-15T17:51:13.066 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:13.105 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:13.262 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-15T17:51:13.281 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-15T17:51:13.322 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-15T17:51:13.458 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-15T17:51:13.477 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-15T17:51:13.518 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-15T17:51:13.709 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-15T17:51:13.726 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-15T17:51:13.767 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:13.907 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-15T17:51:13.923 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-15T17:51:13.964 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:14.078 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package jq. 2024-08-15T17:51:14.097 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-15T17:51:14.162 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:14.226 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package jq. 2024-08-15T17:51:14.243 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-15T17:51:14.283 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:14.468 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package socat. 2024-08-15T17:51:14.489 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-15T17:51:14.526 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-15T17:51:14.570 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package socat. 2024-08-15T17:51:14.586 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-15T17:51:14.628 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-15T17:51:14.871 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package xmlstarlet. 2024-08-15T17:51:14.889 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-15T17:51:14.929 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-15T17:51:14.973 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package xmlstarlet. 2024-08-15T17:51:14.990 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-15T17:51:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-15T17:51:15.309 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-test. 2024-08-15T17:51:15.325 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:15.369 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-test. 2024-08-15T17:51:15.383 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-test (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:15.386 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:15.427 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-test (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:20.031 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-volume. 2024-08-15T17:51:20.048 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:20.054 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-volume. 2024-08-15T17:51:20.071 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:20.108 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-volume (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:20.112 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-volume (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:20.465 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-15T17:51:20.482 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:20.523 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:20.552 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-15T17:51:20.570 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:20.609 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:20.903 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-colorama. 2024-08-15T17:51:20.919 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-15T17:51:20.958 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-15T17:51:20.985 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-colorama. 2024-08-15T17:51:20.999 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-15T17:51:21.041 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-15T17:51:21.247 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephfs-shell. 2024-08-15T17:51:21.266 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:21.305 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephfs-shell (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:21.310 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-shell. 2024-08-15T17:51:21.328 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:21.394 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-shell (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:21.541 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephfs-top. 2024-08-15T17:51:21.560 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:21.624 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephfs-top (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:21.672 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-top. 2024-08-15T17:51:21.688 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2c991c19-1focal_all.deb ... 2024-08-15T17:51:21.730 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-top (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:21.877 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-15T17:51:21.894 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-15T17:51:21.934 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:22.000 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-15T17:51:22.016 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-15T17:51:22.057 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:22.472 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-15T17:51:22.489 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:22.555 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:22.597 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-15T17:51:22.612 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:22.655 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:23.083 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package nvme-cli. 2024-08-15T17:51:23.091 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package nvme-cli. 2024-08-15T17:51:23.099 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-15T17:51:23.109 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-15T17:51:23.159 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-15T17:51:23.184 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-15T17:51:23.462 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-15T17:51:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-15T17:51:23.529 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-15T17:51:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:23.546 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-15T17:51:23.588 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:25.155 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-15T17:51:25.177 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-15T17:51:25.221 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-15T17:51:25.335 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-15T17:51:25.352 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-15T17:51:25.392 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-15T17:51:25.558 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-15T17:51:25.577 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-15T17:51:25.608 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-15T17:51:25.737 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-15T17:51:25.757 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-15T17:51:25.795 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-15T17:51:25.927 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-attr. 2024-08-15T17:51:25.948 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-15T17:51:25.985 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-15T17:51:26.123 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-attr. 2024-08-15T17:51:26.142 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-15T17:51:26.206 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-15T17:51:26.288 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webencodings. 2024-08-15T17:51:26.308 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-15T17:51:26.354 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-15T17:51:26.551 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webencodings. 2024-08-15T17:51:26.570 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-15T17:51:26.609 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-15T17:51:26.682 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-html5lib. 2024-08-15T17:51:26.699 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-15T17:51:26.742 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-15T17:51:26.946 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-html5lib. 2024-08-15T17:51:26.963 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-15T17:51:27.003 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-15T17:51:27.110 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-15T17:51:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-15T17:51:27.168 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-15T17:51:27.373 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-15T17:51:27.393 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-15T17:51:27.464 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-15T17:51:27.646 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pastescript. 2024-08-15T17:51:27.665 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-15T17:51:27.704 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-15T17:51:27.967 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastescript. 2024-08-15T17:51:27.986 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-15T17:51:28.050 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-15T17:51:28.060 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pluggy. 2024-08-15T17:51:28.078 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-15T17:51:28.118 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-15T17:51:28.429 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pluggy. 2024-08-15T17:51:28.447 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-15T17:51:28.454 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-psutil. 2024-08-15T17:51:28.471 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-15T17:51:28.487 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-15T17:51:28.512 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-15T17:51:28.823 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-psutil. 2024-08-15T17:51:28.840 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-15T17:51:28.857 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-py. 2024-08-15T17:51:28.877 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-15T17:51:28.881 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-15T17:51:28.915 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-15T17:51:29.235 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-15T17:51:29.251 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-py. 2024-08-15T17:51:29.252 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-15T17:51:29.268 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-15T17:51:29.302 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-15T17:51:29.309 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-15T17:51:29.630 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pytest. 2024-08-15T17:51:29.647 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-15T17:51:29.679 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-15T17:51:29.688 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-15T17:51:29.696 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-15T17:51:29.737 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-15T17:51:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pytest. 2024-08-15T17:51:30.075 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-simplejson. 2024-08-15T17:51:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-15T17:51:30.092 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-15T17:51:30.133 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-15T17:51:30.156 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-15T17:51:30.464 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-15T17:51:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-15T17:51:30.513 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-15T17:51:30.518 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplejson. 2024-08-15T17:51:30.537 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-15T17:51:30.576 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-15T17:51:30.879 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-15T17:51:30.896 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-15T17:51:30.937 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-15T17:51:31.293 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package radosgw. 2024-08-15T17:51:31.311 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:31.351 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking radosgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:31.741 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package radosgw. 2024-08-15T17:51:31.761 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:31.799 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking radosgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:33.063 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package rbd-fuse. 2024-08-15T17:51:33.081 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:33.137 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking rbd-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:33.451 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-15T17:51:33.584 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package rbd-fuse. 2024-08-15T17:51:33.605 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2c991c19-1focal_amd64.deb ... 2024-08-15T17:51:33.639 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking rbd-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:33.735 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-15T17:51:33.869 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-15T17:51:33.997 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-15T17:51:33.999 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-15T17:51:34.207 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:34.294 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-15T17:51:34.420 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-15T17:51:34.575 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-15T17:51:34.772 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:34.911 INFO:teuthology.orchestra.run.smithi033.stdout:Adding system user cephadm....done 2024-08-15T17:51:35.128 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:35.257 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-15T17:51:35.410 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user cephadm....done 2024-08-15T17:51:35.598 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:35.598 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-15T17:51:35.757 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-15T17:51:35.886 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:36.014 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-15T17:51:36.100 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-15T17:51:36.163 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-15T17:51:36.410 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-15T17:51:36.490 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-15T17:51:36.536 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-15T17:51:36.687 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-15T17:51:36.917 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-15T17:51:37.022 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-15T17:51:37.202 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-15T17:51:37.478 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-15T17:51:37.548 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-15T17:51:37.804 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-15T17:51:37.868 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-15T17:51:38.089 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-15T17:51:38.194 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-15T17:51:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:38.513 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-15T17:51:38.666 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:38.814 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-15T17:51:38.900 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-15T17:51:39.123 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:39.226 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-15T17:51:39.424 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:39.511 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-15T17:51:39.567 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-15T17:51:39.787 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-15T17:51:39.893 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-15T17:51:40.245 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-15T17:51:40.337 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-15T17:51:40.570 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-15T17:51:40.679 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-15T17:51:40.806 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-15T17:51:41.031 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-15T17:51:41.115 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-15T17:51:41.357 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-15T17:51:41.400 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-15T17:51:41.675 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-15T17:51:41.760 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-15T17:51:42.027 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-15T17:51:42.068 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-15T17:51:42.362 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-15T17:51:42.452 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-15T17:51:42.671 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-15T17:51:42.795 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-15T17:51:42.964 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-15T17:51:43.080 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-15T17:51:43.090 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-15T17:51:43.216 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-15T17:51:43.356 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-15T17:51:43.507 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-15T17:51:43.509 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-15T17:51:43.633 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-15T17:51:43.903 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-15T17:51:43.926 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-15T17:51:44.204 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-15T17:51:44.371 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-15T17:51:44.572 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-15T17:51:44.662 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-15T17:51:44.948 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-15T17:51:45.030 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-15T17:51:45.074 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:51:45.398 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-15T17:51:45.549 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:45.635 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-15T17:51:45.876 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:51:45.970 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-15T17:51:46.010 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-15T17:51:46.096 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-15T17:51:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-15T17:51:46.378 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-15T17:51:46.531 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-15T17:51:46.537 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-15T17:51:46.663 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-15T17:51:46.866 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:51:46.964 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-15T17:51:46.984 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-15T17:51:47.110 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-15T17:51:47.324 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:51:47.450 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-15T17:51:47.453 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-15T17:51:47.595 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-15T17:51:47.746 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-15T17:51:47.927 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-15T17:51:48.039 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-15T17:51:48.190 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-15T17:51:48.212 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-15T17:51:48.466 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-15T17:51:48.530 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-15T17:51:48.656 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-15T17:51:48.759 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-15T17:51:48.932 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-15T17:51:49.060 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-15T17:51:49.225 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-15T17:51:49.479 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-15T17:51:49.534 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-15T17:51:49.738 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-15T17:51:49.864 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-15T17:51:49.882 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-15T17:51:50.170 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-15T17:51:50.190 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-15T17:51:50.321 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-15T17:51:50.542 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-15T17:51:50.639 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-15T17:51:50.693 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-15T17:51:50.818 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-15T17:51:50.990 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-15T17:51:51.118 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-15T17:51:51.153 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-15T17:51:51.267 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-15T17:51:51.438 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librados2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:51.597 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-15T17:51:51.602 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-15T17:51:51.886 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librados2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:52.046 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-15T17:51:53.128 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:53.254 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:53.380 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-15T17:51:53.518 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:53.644 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:53.790 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-15T17:51:53.795 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-15T17:51:54.091 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-15T17:51:54.188 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-15T17:51:54.416 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:51:54.481 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-15T17:51:54.560 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-15T17:51:54.757 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-15T17:51:54.883 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-15T17:51:54.944 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libcephfs2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:55.070 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-15T17:51:55.259 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:55.385 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-15T17:51:55.406 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libradosstriper1 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:55.532 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-15T17:51:55.712 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libradosstriper1 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:55.880 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-15T17:51:56.000 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:56.222 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-15T17:51:57.097 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librbd1 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:57.223 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-15T17:51:57.294 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librbd1 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:57.374 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-15T17:51:57.429 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-15T17:51:57.509 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:57.555 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-15T17:51:57.634 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-15T17:51:57.723 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-15T17:51:57.849 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-15T17:51:57.952 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-15T17:51:58.070 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-15T17:51:58.192 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-15T17:51:58.317 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-15T17:51:58.482 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:58.608 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:58.738 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:58.836 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-15T17:51:58.837 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-15T17:51:58.889 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:59.108 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-15T17:51:59.108 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-15T17:51:59.301 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libcephfs-dev (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:59.411 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-15T17:51:59.565 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs-dev (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:51:59.725 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-15T17:51:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-15T17:52:00.018 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-15T17:52:00.030 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-15T17:52:00.338 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-15T17:52:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rados (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.509 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librgw2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.655 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephfs-top (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.689 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rados (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.770 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rbd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.814 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librgw2 (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.921 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up rbd-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:00.974 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-top (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:01.047 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-15T17:52:01.100 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rbd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:01.251 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up rbd-fuse (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:01.377 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-15T17:52:01.381 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-15T17:52:01.683 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-15T17:52:01.809 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cephfs (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:01.935 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephfs-shell (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:02.038 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:02.044 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-15T17:52:02.190 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cephfs (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:02.315 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-shell (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:02.474 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-15T17:52:03.006 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:03.377 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-common (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:03.626 INFO:teuthology.orchestra.run.smithi033.stdout:Adding group ceph....done 2024-08-15T17:52:03.997 INFO:teuthology.orchestra.run.smithi105.stdout:Adding group ceph....done 2024-08-15T17:52:04.023 INFO:teuthology.orchestra.run.smithi033.stdout:Adding system user ceph....done 2024-08-15T17:52:04.204 INFO:teuthology.orchestra.run.smithi033.stdout:Setting system user ceph properties....done 2024-08-15T17:52:04.231 INFO:teuthology.orchestra.run.smithi033.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-15T17:52:04.373 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user ceph....done 2024-08-15T17:52:04.382 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-15T17:52:04.541 INFO:teuthology.orchestra.run.smithi105.stdout:Setting system user ceph properties....done 2024-08-15T17:52:04.561 INFO:teuthology.orchestra.run.smithi105.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-15T17:52:04.707 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-15T17:52:04.708 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-15T17:52:05.026 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-15T17:52:05.175 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephfs-mirror (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:05.408 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-15T17:52:05.408 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-15T17:52:05.479 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-mirror (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:05.703 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-15T17:52:05.703 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-15T17:52:05.909 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-test (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:06.136 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up radosgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:06.138 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-test (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:06.298 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up radosgw (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:06.396 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-15T17:52:06.397 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-15T17:52:06.569 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-15T17:52:06.569 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-15T17:52:07.055 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-base (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:07.208 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-base (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:07.446 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-15T17:52:07.604 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-15T17:52:07.915 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mds (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:08.158 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-15T17:52:08.158 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-15T17:52:08.345 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mds (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:08.584 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:08.597 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-15T17:52:08.597 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-15T17:52:08.814 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-15T17:52:08.814 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-15T17:52:09.038 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:09.268 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-osd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-15T17:52:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-15T17:52:09.723 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-osd (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:09.791 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-15T17:52:09.791 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-15T17:52:10.251 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-15T17:52:10.252 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-15T17:52:10.258 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:10.388 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:10.522 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mon (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:10.708 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:10.754 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-15T17:52:10.755 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-15T17:52:10.834 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mon (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:11.219 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-15T17:52:11.219 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-15T17:52:11.240 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:11.678 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:11.784 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:11.829 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:11.980 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:12.027 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:12.123 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-volume (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:12.203 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-volume (17.2.7-1375-g2c991c19-1focal) ... 2024-08-15T17:52:12.275 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-15T17:52:12.330 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-15T17:52:12.426 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-15T17:52:12.481 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-15T17:52:12.694 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-15T17:52:12.758 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-15T17:52:15.507 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-15T17:52:15.794 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-15T17:52:16.134 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-15T17:52:16.137 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-15T17:52:16.206 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-08-15T17:52:16.421 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2024-08-15T17:52:16.422 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2024-08-15T17:52:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-15T17:52:16.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-15T17:52:16.513 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2024-08-15T17:52:16.621 INFO:teuthology.orchestra.run.smithi105.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-15T17:52:16.621 INFO:teuthology.orchestra.run.smithi105.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-15T17:52:16.621 INFO:teuthology.orchestra.run.smithi105.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-15T17:52:16.621 INFO:teuthology.orchestra.run.smithi105.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-15T17:52:16.621 INFO:teuthology.orchestra.run.smithi105.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-15T17:52:16.621 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2024-08-15T17:52:16.622 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-15T17:52:16.622 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-15T17:52:16.623 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2024-08-15T17:52:16.623 INFO:teuthology.orchestra.run.smithi105.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-15T17:52:16.623 INFO:teuthology.orchestra.run.smithi105.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-15T17:52:16.623 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-15T17:52:16.623 INFO:teuthology.orchestra.run.smithi105.stdout: usb-modeswitch-data wpasupplicant 2024-08-15T17:52:16.624 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2024-08-15T17:52:16.624 INFO:teuthology.orchestra.run.smithi105.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-15T17:52:16.624 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-15T17:52:16.677 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2024-08-15T17:52:16.677 INFO:teuthology.orchestra.run.smithi105.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-15T17:52:16.678 INFO:teuthology.orchestra.run.smithi105.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-15T17:52:16.678 INFO:teuthology.orchestra.run.smithi105.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-15T17:52:16.678 INFO:teuthology.orchestra.run.smithi105.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-15T17:52:16.679 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2024-08-15T17:52:16.680 INFO:teuthology.orchestra.run.smithi105.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-15T17:52:16.735 INFO:teuthology.orchestra.run.smithi105.stdout:6 upgraded, 23 newly installed, 0 to remove and 288 not upgraded. 2024-08-15T17:52:16.735 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 10.4 MB of archives. 2024-08-15T17:52:16.736 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-15T17:52:16.736 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-15T17:52:16.744 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2024-08-15T17:52:16.745 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2024-08-15T17:52:16.867 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-15T17:52:16.868 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-15T17:52:16.870 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-15T17:52:16.875 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-15T17:52:16.876 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-15T17:52:16.892 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-15T17:52:16.892 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-15T17:52:16.893 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-15T17:52:16.894 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-15T17:52:16.895 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-15T17:52:16.901 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-15T17:52:16.902 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-15T17:52:16.903 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-15T17:52:16.904 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-15T17:52:16.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-15T17:52:16.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-15T17:52:16.923 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-15T17:52:16.933 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-15T17:52:16.933 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-15T17:52:16.947 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-15T17:52:16.948 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-15T17:52:16.955 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-15T17:52:16.965 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-15T17:52:16.980 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-15T17:52:16.982 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-15T17:52:16.983 INFO:teuthology.orchestra.run.smithi033.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-15T17:52:16.983 INFO:teuthology.orchestra.run.smithi033.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-15T17:52:16.983 INFO:teuthology.orchestra.run.smithi033.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-15T17:52:16.983 INFO:teuthology.orchestra.run.smithi033.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-15T17:52:16.984 INFO:teuthology.orchestra.run.smithi033.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-15T17:52:16.984 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2024-08-15T17:52:16.984 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-15T17:52:16.984 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-15T17:52:16.984 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-15T17:52:16.985 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-15T17:52:16.985 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-15T17:52:16.985 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2024-08-15T17:52:16.985 INFO:teuthology.orchestra.run.smithi033.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-15T17:52:16.985 INFO:teuthology.orchestra.run.smithi033.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-15T17:52:16.985 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-15T17:52:16.986 INFO:teuthology.orchestra.run.smithi033.stdout: usb-modeswitch-data wpasupplicant 2024-08-15T17:52:16.987 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2024-08-15T17:52:16.987 INFO:teuthology.orchestra.run.smithi033.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-15T17:52:16.987 INFO:teuthology.orchestra.run.smithi033.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-15T17:52:17.041 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2024-08-15T17:52:17.041 INFO:teuthology.orchestra.run.smithi033.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-15T17:52:17.041 INFO:teuthology.orchestra.run.smithi033.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-15T17:52:17.042 INFO:teuthology.orchestra.run.smithi033.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-15T17:52:17.042 INFO:teuthology.orchestra.run.smithi033.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-15T17:52:17.043 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2024-08-15T17:52:17.044 INFO:teuthology.orchestra.run.smithi033.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-15T17:52:17.101 INFO:teuthology.orchestra.run.smithi033.stdout:6 upgraded, 23 newly installed, 0 to remove and 288 not upgraded. 2024-08-15T17:52:17.101 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 10.4 MB of archives. 2024-08-15T17:52:17.101 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-15T17:52:17.101 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-15T17:52:17.234 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-15T17:52:17.235 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-15T17:52:17.236 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-15T17:52:17.240 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-15T17:52:17.241 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-15T17:52:17.258 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-15T17:52:17.259 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-15T17:52:17.260 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-15T17:52:17.262 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-15T17:52:17.262 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-15T17:52:17.267 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-15T17:52:17.268 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-15T17:52:17.269 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-15T17:52:17.270 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-15T17:52:17.284 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-15T17:52:17.285 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-15T17:52:17.290 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-15T17:52:17.298 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-15T17:52:17.299 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-15T17:52:17.306 INFO:teuthology.orchestra.run.smithi105.stdout:Preconfiguring packages ... 2024-08-15T17:52:17.313 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-15T17:52:17.313 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-15T17:52:17.320 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-15T17:52:17.330 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-15T17:52:17.345 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-15T17:52:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-15T17:52:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-15T17:52:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-15T17:52:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-15T17:52:17.453 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 10.4 MB in 0s (35.2 MB/s) 2024-08-15T17:52:17.675 INFO:teuthology.orchestra.run.smithi033.stdout:Preconfiguring packages ... 2024-08-15T17:52:17.749 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-15T17:52:17.754 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-15T17:52:17.805 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 10.4 MB in 0s (35.1 MB/s) 2024-08-15T17:52:17.909 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-15T17:52:18.121 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-15T17:52:18.125 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-15T17:52:18.280 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-15T17:52:19.470 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-15T17:52:19.599 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-15T17:52:20.924 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-15T17:52:20.929 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-15T17:52:21.012 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-15T17:52:21.016 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-15T17:52:21.053 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-15T17:52:21.173 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-15T17:52:21.443 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-15T17:52:21.604 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-15T17:52:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-15T17:52:21.796 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-15T17:52:21.964 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-15T17:52:22.158 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-15T17:52:22.608 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-15T17:52:22.612 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-15T17:52:22.796 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-15T17:52:22.984 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-15T17:52:22.989 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-15T17:52:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-15T17:52:23.262 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-15T17:52:23.409 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-15T17:52:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-15T17:52:23.684 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-15T17:52:23.948 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-15T17:52:24.198 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-15T17:52:24.364 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-15T17:52:24.457 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-15T17:52:24.901 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-15T17:52:24.919 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-15T17:52:24.959 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-15T17:52:24.994 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-15T17:52:25.014 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-15T17:52:25.077 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-15T17:52:25.312 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package dump. 2024-08-15T17:52:25.330 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking dump (0.4b46-6) ... 2024-08-15T17:52:25.447 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package dump. 2024-08-15T17:52:25.464 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-15T17:52:25.505 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking dump (0.4b46-6) ... 2024-08-15T17:52:25.681 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package indent. 2024-08-15T17:52:25.700 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-15T17:52:25.749 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-15T17:52:25.834 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package indent. 2024-08-15T17:52:25.854 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-15T17:52:25.892 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-15T17:52:26.077 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-15T17:52:26.094 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-15T17:52:26.157 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-15T17:52:26.278 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-15T17:52:26.296 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-15T17:52:26.337 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-15T17:52:26.505 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-15T17:52:26.523 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-15T17:52:26.563 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-15T17:52:26.699 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-15T17:52:26.716 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-15T17:52:26.757 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-15T17:52:26.849 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-15T17:52:26.869 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-15T17:52:26.907 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:27.043 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-15T17:52:27.062 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-15T17:52:27.117 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:27.277 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-15T17:52:27.297 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:27.335 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:27.505 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-15T17:52:27.523 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:27.562 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:27.646 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-15T17:52:27.663 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:27.825 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:27.874 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-15T17:52:27.891 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:27.932 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:28.310 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-15T17:52:28.330 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:28.368 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:28.754 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-15T17:52:28.771 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-15T17:52:28.812 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-15T17:52:28.893 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-15T17:52:28.914 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:28.951 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:29.207 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-15T17:52:29.224 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-15T17:52:29.265 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:29.345 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-15T17:52:29.363 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-15T17:52:29.404 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-15T17:52:29.757 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-15T17:52:29.774 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-15T17:52:29.815 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:29.870 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-15T17:52:29.887 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:30.035 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:30.226 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-15T17:52:30.243 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:30.284 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:30.406 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-15T17:52:30.423 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:30.464 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:30.629 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-15T17:52:30.649 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:30.687 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:30.741 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-15T17:52:30.760 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-15T17:52:30.802 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-15T17:52:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-15T17:52:30.934 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-15T17:52:30.972 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-15T17:52:31.345 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-15T17:52:31.363 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-15T17:52:31.403 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-15T17:52:31.476 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-15T17:52:31.494 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-15T17:52:31.568 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-15T17:52:31.806 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package modemmanager. 2024-08-15T17:52:31.824 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:31.892 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:31.946 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package modemmanager. 2024-08-15T17:52:31.963 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-15T17:52:32.048 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package wpasupplicant. 2024-08-15T17:52:32.564 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-15T17:52:32.604 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-15T17:52:32.702 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package wpasupplicant. 2024-08-15T17:52:32.719 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-15T17:52:32.760 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-15T17:52:33.209 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager. 2024-08-15T17:52:33.227 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-15T17:52:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:33.315 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package network-manager. 2024-08-15T17:52:33.332 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-15T17:52:33.397 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:34.083 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ppp. 2024-08-15T17:52:34.100 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-15T17:52:34.399 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-15T17:52:34.499 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ppp. 2024-08-15T17:52:34.516 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-15T17:52:34.769 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-15T17:52:34.813 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package pptp-linux. 2024-08-15T17:52:34.829 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-15T17:52:34.871 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-15T17:52:35.162 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package pptp-linux. 2024-08-15T17:52:35.180 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-15T17:52:35.220 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-15T17:52:35.452 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-15T17:52:35.473 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-15T17:52:35.544 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-15T17:52:35.599 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-15T17:52:35.769 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-15T17:52:35.769 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-15T17:52:35.771 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-15T17:52:35.788 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-15T17:52:35.821 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-15T17:52:35.919 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-15T17:52:35.938 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-15T17:52:35.976 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-15T17:52:36.265 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-15T17:52:36.283 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-15T17:52:36.334 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-15T17:52:36.379 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-15T17:52:36.398 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-15T17:52:36.448 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-15T17:52:36.659 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-15T17:52:36.759 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-15T17:52:36.962 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-15T17:52:37.088 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-15T17:52:37.101 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-15T17:52:37.211 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-15T17:52:37.239 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-15T17:52:37.338 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-15T17:52:37.667 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-15T17:52:37.667 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-15T17:52:37.708 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-15T17:52:37.708 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-15T17:52:38.126 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-15T17:52:38.173 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-15T17:52:38.252 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-15T17:52:38.332 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-15T17:52:38.403 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-15T17:52:38.458 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-15T17:52:38.529 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-15T17:52:38.584 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-15T17:52:38.680 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:38.739 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:38.805 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-15T17:52:38.844 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-15T17:52:39.799 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-15T17:52:39.833 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-15T17:52:40.033 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up dump (0.4b46-6) ... 2024-08-15T17:52:40.078 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up dump (0.4b46-6) ... 2024-08-15T17:52:40.120 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-15T17:52:40.157 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-15T17:52:40.210 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:40.213 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:40.336 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-15T17:52:40.372 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-15T17:52:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-15T17:52:40.498 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-15T17:52:40.605 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-15T17:52:40.800 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-15T17:52:40.806 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-15T17:52:40.932 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:41.058 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:41.201 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-15T17:52:41.284 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-15T17:52:41.369 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:41.435 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:41.495 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:41.545 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:41.646 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-15T17:52:41.822 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:41.969 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:which means they are currently configured by ifupdown: 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:- ens1f0 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:remove their configuration from /etc/network/interfaces. 2024-08-15T17:52:42.222 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:42.372 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout:which means they are currently configured by ifupdown: 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout:- enp3s0f1 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout:remove their configuration from /etc/network/interfaces. 2024-08-15T17:52:42.680 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:42.705 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-15T17:52:42.836 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-15T17:52:43.155 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-15T17:52:43.236 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-15T17:52:43.703 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-15T17:52:43.723 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:43.867 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-15T17:52:44.034 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:44.160 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:44.176 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-15T17:52:44.278 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:44.322 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-15T17:52:44.404 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:44.471 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-15T17:52:44.596 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:44.723 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-15T17:52:44.724 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-15T17:52:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-15T17:52:44.890 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-15T17:52:45.195 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-15T17:52:45.196 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-15T17:52:45.239 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-15T17:52:45.332 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-15T17:52:45.483 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-15T17:52:45.635 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-15T17:52:45.709 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-15T17:52:45.810 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-15T17:52:45.961 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-15T17:52:45.978 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-15T17:52:46.121 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-15T17:52:46.639 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-15T17:52:49.822 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-15T17:52:49.922 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-15T17:52:50.592 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-15T17:52:50.692 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-15T17:52:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-15T17:52:51.232 DEBUG:teuthology.parallel:result is None 2024-08-15T17:52:51.528 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-15T17:52:51.533 DEBUG:teuthology.parallel:result is None 2024-08-15T17:52:51.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2c991c196a651f8ef0f36c7763ec87a241b25549 2024-08-15T17:52:51.677 DEBUG:teuthology.orchestra.run.smithi033:> dpkg-query -W -f '${Version}' ceph 2024-08-15T17:52:51.701 INFO:teuthology.orchestra.run.smithi033.stdout:17.2.7-1375-g2c991c19-1focal 2024-08-15T17:52:51.701 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2c991c19-1focal 2024-08-15T17:52:51.701 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2c991c19-1focal is installed. 2024-08-15T17:52:51.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2c991c196a651f8ef0f36c7763ec87a241b25549 2024-08-15T17:52:51.849 DEBUG:teuthology.orchestra.run.smithi105:> dpkg-query -W -f '${Version}' ceph 2024-08-15T17:52:51.873 INFO:teuthology.orchestra.run.smithi105.stdout:17.2.7-1375-g2c991c19-1focal 2024-08-15T17:52:51.873 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2c991c19-1focal 2024-08-15T17:52:51.873 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2c991c19-1focal is installed. 2024-08-15T17:52:51.875 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-15T17:52:51.876 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:51.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-15T17:52:51.893 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:51.893 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-15T17:52:51.931 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-15T17:52:51.931 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:51.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-08-15T17:52:51.951 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-15T17:52:51.961 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:51.962 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-08-15T17:52:51.977 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-15T17:52:52.033 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-15T17:52:52.034 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:52.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-15T17:52:52.050 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-15T17:52:52.063 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:52.064 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-15T17:52:52.079 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-15T17:52:52.089 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-15T17:52:52.089 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:52.089 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-08-15T17:52:52.104 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-15T17:52:52.162 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:52.163 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-08-15T17:52:52.179 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-15T17:52:52.189 INFO:teuthology.run_tasks:Running task ceph... 2024-08-15T17:52:52.278 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-15T17:52:52.278 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2024-08-15T17:52:52.281 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2024-08-15T17:52:52.296 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-15T17:52:52.296 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-15T17:52:52.299 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-15T17:52:52.354 INFO:tasks.ceph:Creating extra log directories... 2024-08-15T17:52:52.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-15T17:52:52.357 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-15T17:52:52.424 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-15T17:52:52.425 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-15T17:52:52.425 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-15T17:52:52.425 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:52.425 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-15T17:52:52.432 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-15T17:52:52.512 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:52.512 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-15T17:52:52.523 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-15T17:52:52.567 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-15T17:52:52.567 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-15T17:52:52.568 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7857029', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549', 'targets': {'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2c991c196a651f8ef0f36c7763ec87a241b25549', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-15_16:39:12', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-15T17:52:52.568 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-15T17:52:52.571 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-15T17:52:52.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2024-08-15T17:52:52.620 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2024-08-15T17:52:52.634 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:52.634 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-08-15T17:52:52.642 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-15T17:52:52.642 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-08-15T17:52:52.649 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-15 17:48:39.852528437 +0000 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-15 17:48:39.640533324 +0000 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-15 17:48:39.640533324 +0000 2024-08-15T17:52:52.650 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-08-15T17:52:52.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-15T17:52:52.705 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-15T17:52:52.705 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-15T17:52:52.705 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000432763 s, 1.2 MB/s 2024-08-15T17:52:52.706 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-15T17:52:52.715 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-08-15T17:52:52.721 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-15T17:52:52.721 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:52.721 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-08-15T17:52:52.721 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:52.721 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-15 17:48:40.064523551 +0000 2024-08-15T17:52:52.722 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-15 17:48:40.060523643 +0000 2024-08-15T17:52:52.722 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-15 17:48:40.060523643 +0000 2024-08-15T17:52:52.722 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-08-15T17:52:52.722 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-15T17:52:52.777 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-15T17:52:52.777 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-15T17:52:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000399261 s, 1.3 MB/s 2024-08-15T17:52:52.779 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-15T17:52:52.786 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-15 17:48:40.516513132 +0000 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-15 17:48:40.512513225 +0000 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-15 17:48:40.512513225 +0000 2024-08-15T17:52:52.791 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-08-15T17:52:52.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-15T17:52:52.849 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-15T17:52:52.849 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-15T17:52:52.849 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000401231 s, 1.3 MB/s 2024-08-15T17:52:52.851 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-15T17:52:52.858 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-08-15T17:52:52.864 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-15T17:52:52.864 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:52.865 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-08-15T17:52:52.865 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:52.865 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-15 17:48:41.156498380 +0000 2024-08-15T17:52:52.865 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-15 17:48:40.940503359 +0000 2024-08-15T17:52:52.865 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-15 17:48:40.940503359 +0000 2024-08-15T17:52:52.865 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-08-15T17:52:52.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-15T17:52:52.921 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-15T17:52:52.922 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-15T17:52:52.922 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000371699 s, 1.4 MB/s 2024-08-15T17:52:52.923 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-15T17:52:52.930 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-15T17:52:52.934 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:52.934 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-08-15T17:52:52.943 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-15T17:52:52.943 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-08-15T17:52:52.990 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-15T17:52:52.990 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:52.990 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-08-15T17:52:52.990 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:52.990 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-08-15 17:48:39.996509259 +0000 2024-08-15T17:52:52.990 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-08-15 17:48:39.992509350 +0000 2024-08-15T17:52:52.991 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-08-15 17:48:39.992509350 +0000 2024-08-15T17:52:52.991 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2024-08-15T17:52:52.991 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-15T17:52:53.005 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-08-15T17:52:53.006 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-08-15T17:52:53.006 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000430217 s, 1.2 MB/s 2024-08-15T17:52:53.007 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-15T17:52:53.013 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-08-15T17:52:53.062 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-15T17:52:53.062 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:53.062 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-08-15T17:52:53.062 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:53.062 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-08-15 17:48:40.440499024 +0000 2024-08-15T17:52:53.063 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-08-15 17:48:40.436499117 +0000 2024-08-15T17:52:53.063 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-08-15 17:48:40.436499117 +0000 2024-08-15T17:52:53.063 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2024-08-15T17:52:53.063 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-15T17:52:53.078 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-08-15T17:52:53.078 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-08-15T17:52:53.078 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000409981 s, 1.2 MB/s 2024-08-15T17:52:53.079 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-15T17:52:53.087 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-08-15 17:48:41.112483535 +0000 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-08-15 17:48:40.912488145 +0000 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-08-15 17:48:40.912488145 +0000 2024-08-15T17:52:53.141 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2024-08-15T17:52:53.142 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-15T17:52:53.154 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-08-15T17:52:53.154 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-08-15T17:52:53.154 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000415231 s, 1.2 MB/s 2024-08-15T17:52:53.156 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-15T17:52:53.163 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-08-15T17:52:53.170 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-08-15 17:48:41.536473762 +0000 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-08-15 17:48:41.316478833 +0000 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-08-15 17:48:41.316478833 +0000 2024-08-15T17:52:53.171 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2024-08-15T17:52:53.171 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-15T17:52:53.225 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-08-15T17:52:53.226 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-08-15T17:52:53.226 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000396031 s, 1.3 MB/s 2024-08-15T17:52:53.226 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-15T17:52:53.235 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-15T17:52:53.236 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-15T17:52:53.236 INFO:tasks.ceph:Generating config... 2024-08-15T17:52:53.237 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-15T17:52:53.237 INFO:tasks.ceph:[client] debug client = 20 2024-08-15T17:52:53.237 INFO:tasks.ceph:[client] debug ms = 1 2024-08-15T17:52:53.237 INFO:tasks.ceph:[client] pid file = 2024-08-15T17:52:53.237 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-15T17:52:53.237 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-15T17:52:53.238 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-15T17:52:53.239 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-15T17:52:53.239 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-15T17:52:53.239 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-15T17:52:53.239 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-15T17:52:53.239 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-15T17:52:53.239 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-15T17:52:53.239 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-15T17:52:53.240 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-15T17:52:53.240 INFO:tasks.ceph:Setting up mon.a... 2024-08-15T17:52:53.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-15T17:52:53.274 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2024-08-15T17:52:53.278 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-15T17:52:53.313 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-15T17:52:53.370 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2024-08-15T17:52:53.370 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-15T17:52:53.371 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:53.371 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-15T17:52:53.376 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid 55bddac8-0f58-4a43-a3ea-a8daa20f3e0c 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = octopus 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 55bddac8-0f58-4a43-a3ea-a8daa20f3e0c 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2024-08-15T17:52:53.419851+0000 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-08-15T17:52:53.419851+0000 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 15 (octopus) 2024-08-15T17:52:53.417 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2024-08-15T17:52:53.418 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-15T17:52:53.418 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-08-15T17:52:53.418 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2024-08-15T17:52:53.418 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-15T17:52:53.419 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-15T17:52:53.469 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 55bddac8-0f58-4a43-a3ea-a8daa20f3e0c... 2024-08-15T17:52:53.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-15T17:52:53.472 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-15T17:52:53.505 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2024-08-15T17:52:53.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2024-08-15T17:52:53.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2024-08-15T17:52:53.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2024-08-15T17:52:53.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2024-08-15T17:52:53.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2024-08-15T17:52:53.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2024-08-15T17:52:53.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2024-08-15T17:52:53.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-15T17:52:53.509 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-15T17:52:53.509 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2024-08-15T17:52:53.510 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-15T17:52:53.510 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2024-08-15T17:52:53.510 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.510 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.33,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 55bddac8-0f58-4a43-a3ea-a8daa20f3e0c 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2024-08-15T17:52:53.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2024-08-15T17:52:53.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2024-08-15T17:52:53.513 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2024-08-15T17:52:53.514 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug finisher = 20 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2024-08-15T17:52:53.515 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2024-08-15T17:52:53.516 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2024-08-15T17:52:53.517 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-08-15T17:52:53.518 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds balancer = 20 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2024-08-15T17:52:53.519 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2024-08-15T17:52:53.520 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-08-15T17:52:53.520 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-08-15T17:52:53.520 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-08-15T17:52:53.521 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-08-15T17:52:53.521 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2024-08-15T17:52:53.521 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2024-08-15T17:52:53.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2024-08-15T17:52:53.523 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.524 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 55bddac8-0f58-4a43-a3ea-a8daa20f3e0c 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2024-08-15T17:52:53.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2024-08-15T17:52:53.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2024-08-15T17:52:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2024-08-15T17:52:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2024-08-15T17:52:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.529 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2024-08-15T17:52:53.529 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2024-08-15T17:52:53.529 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.529 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2024-08-15T17:52:53.530 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2024-08-15T17:52:53.530 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2024-08-15T17:52:53.530 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2024-08-15T17:52:53.530 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2024-08-15T17:52:53.530 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2024-08-15T17:52:53.531 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-08-15T17:52:53.532 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: debug finisher = 20 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2024-08-15T17:52:53.533 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.534 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-15T17:52:53.535 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = "" 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2024-08-15T17:52:53.536 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2024-08-15T17:52:53.537 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2024-08-15T17:52:53.537 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-08-15T17:52:53.537 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2024-08-15T17:52:53.537 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-08-15T17:52:53.537 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2024-08-15T17:52:53.538 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2024-08-15T17:52:53.538 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2024-08-15T17:52:53.538 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds balancer = 20 2024-08-15T17:52:53.538 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-08-15T17:52:53.538 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2024-08-15T17:52:53.538 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2024-08-15T17:52:53.539 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2024-08-15T17:52:53.539 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2024-08-15T17:52:53.539 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-08-15T17:52:53.539 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-08-15T17:52:53.540 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-08-15T17:52:53.540 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-15T17:52:53.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-15T17:52:53.614 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-15T17:52:53.614 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:53.614 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-15T17:52:53.622 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:53.622 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-15T17:52:53.629 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:52:53.629 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:53.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-15T17:52:53.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-15T17:52:53.698 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:52:53.698 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:52:53.702 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:52:53.703 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:53.703 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-15T17:52:53.703 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-15T17:52:53.728 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:52:53.729 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:52:53.734 INFO:tasks.ceph:Setting up mon nodes... 2024-08-15T17:52:53.734 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-15T17:52:53.734 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-15T17:52:53.781 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-15T17:52:53.783 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-15T17:52:53.830 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-15T17:52:53.833 INFO:tasks.ceph:Setting up mds nodes... 2024-08-15T17:52:53.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-15T17:52:53.882 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-15T17:52:53.884 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-15T17:52:53.895 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-15T17:52:53.934 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-15T17:52:53.937 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-15T17:52:53.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-15T17:52:54.042 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-15T17:52:54.045 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-15T17:52:54.055 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-15T17:52:54.093 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-15T17:52:54.096 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-15T17:52:54.108 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-15T17:52:54.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-15T17:52:54.144 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-15T17:52:54.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-15T17:52:54.189 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-15T17:52:54.201 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-15T17:52:54.247 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-15T17:52:54.262 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-15T17:52:54.289 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-15T17:52:54.300 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-15T17:52:54.300 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-15T17:52:54.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-15T17:52:54.318 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-15T17:52:54.318 INFO:tasks.ceph:role: osd.0 2024-08-15T17:52:54.318 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:52:54.318 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:52:54.857 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:52:54.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-08-15T17:52:54.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-15T17:52:54.971 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-15T17:52:54.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:52:54.984 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:52:54.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-15T17:52:55.001 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-15T17:52:55.001 INFO:tasks.ceph:role: osd.1 2024-08-15T17:52:55.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:52:55.001 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-15T17:52:55.524 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:52:55.525 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:52:55.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-08-15T17:52:55.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-15T17:52:55.562 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-15T17:52:55.618 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:52:55.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:52:55.620 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-15T17:52:55.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-15T17:52:55.635 INFO:tasks.ceph:role: osd.2 2024-08-15T17:52:55.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:52:55.635 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-15T17:52:56.096 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:52:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:52:56.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-08-15T17:52:56.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-15T17:52:56.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-15T17:52:56.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:52:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:52:56.159 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-15T17:52:56.174 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-15T17:52:56.174 INFO:tasks.ceph:role: osd.3 2024-08-15T17:52:56.174 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:52:56.174 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:52:56.723 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:52:56.723 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:52:56.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-08-15T17:52:56.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-15T17:52:56.791 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-15T17:52:56.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:52:56.804 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:52:56.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:52:56.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:56.883+0000 7f65110bb3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-15T17:52:56.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:56.883+0000 7f65110bb3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-15T17:52:56.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:56.883+0000 7f65110bb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-15T17:52:56.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:56.883+0000 7f65110bb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-15T17:52:56.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:56.883+0000 7f65110bb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-15T17:52:56.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:56.887+0000 7f65110bb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-15T17:52:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:57.451+0000 7f65110bb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:52:58.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:58.227+0000 7f65110bb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:52:59.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.007+0000 7f65110bb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:52:59.863 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-15T17:52:59.881 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:52:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.963+0000 7f47c0fee3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-15T17:52:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.963+0000 7f47c0fee3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-15T17:52:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.963+0000 7f47c0fee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-15T17:52:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.963+0000 7f47c0fee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-15T17:52:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.963+0000 7f47c0fee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-15T17:52:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:52:59.967+0000 7f47c0fee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-15T17:53:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:00.527+0000 7f47c0fee3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:01.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:01.307+0000 7f47c0fee3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.099+0000 7f47c0fee3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:02.947 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-15T17:53:02.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:03.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.999+0000 7f39c00993c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-15T17:53:03.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.999+0000 7f39c00993c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-15T17:53:03.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.999+0000 7f39c00993c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-15T17:53:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.999+0000 7f39c00993c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-15T17:53:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.999+0000 7f39c00993c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-15T17:53:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:02.999+0000 7f39c00993c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-15T17:53:03.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:03.555+0000 7f39c00993c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:04.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:04.339+0000 7f39c00993c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:05.119+0000 7f39c00993c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:05.958 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-15T17:53:05.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.059+0000 7fc0c083b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-15T17:53:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.059+0000 7fc0c083b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-15T17:53:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.059+0000 7fc0c083b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-15T17:53:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.059+0000 7fc0c083b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-15T17:53:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.059+0000 7fc0c083b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-15T17:53:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.059+0000 7fc0c083b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-15T17:53:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:06.615+0000 7fc0c083b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:07.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:07.399+0000 7fc0c083b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:08.179+0000 7fc0c083b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:09.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-15T17:53:09.047 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-15T17:53:09.064 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-15T17:53:09.064 INFO:tasks.ceph:role: osd.4 2024-08-15T17:53:09.064 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:53:09.064 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-15T17:53:09.609 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:53:09.610 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:53:09.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-08-15T17:53:09.612 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-15T17:53:09.703 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-15T17:53:09.713 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:53:09.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:53:09.714 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-15T17:53:09.771 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-15T17:53:09.771 INFO:tasks.ceph:role: osd.5 2024-08-15T17:53:09.771 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:53:09.772 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-15T17:53:10.287 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:53:10.287 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:53:10.287 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:53:10.288 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:53:10.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-08-15T17:53:10.289 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-15T17:53:10.327 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-15T17:53:10.339 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:53:10.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:53:10.341 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-15T17:53:10.399 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-15T17:53:10.400 INFO:tasks.ceph:role: osd.6 2024-08-15T17:53:10.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:53:10.400 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-15T17:53:10.860 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:53:10.861 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:53:10.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-08-15T17:53:10.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-15T17:53:10.924 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-15T17:53:10.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:53:10.935 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:53:10.935 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-15T17:53:10.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-15T17:53:10.946 INFO:tasks.ceph:role: osd.7 2024-08-15T17:53:10.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:53:10.947 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-08-15T17:53:11.468 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-15T17:53:11.469 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-15T17:53:11.469 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-15T17:53:11.469 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-15T17:53:11.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-08-15T17:53:11.470 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-15T17:53:11.541 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-15T17:53:11.554 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-08-15T17:53:11.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:53:11.555 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:11.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:11.634+0000 7f9017d463c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-15T17:53:11.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:11.634+0000 7f9017d463c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-15T17:53:11.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:11.634+0000 7f9017d463c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-15T17:53:11.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:11.634+0000 7f9017d463c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-15T17:53:11.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:11.634+0000 7f9017d463c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-15T17:53:11.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:11.634+0000 7f9017d463c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-15T17:53:12.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:12.198+0000 7f9017d463c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:12.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:12.982+0000 7f9017d463c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:13.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:13.766+0000 7f9017d463c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:14.636 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-15T17:53:14.652 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:14.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:14.690+0000 7f808a5323c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-15T17:53:14.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:14.694+0000 7f808a5323c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-15T17:53:14.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:14.694+0000 7f808a5323c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-15T17:53:14.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:14.694+0000 7f808a5323c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-15T17:53:14.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:14.694+0000 7f808a5323c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-15T17:53:14.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:14.694+0000 7f808a5323c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-15T17:53:15.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:15.250+0000 7f808a5323c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:16.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:16.034+0000 7f808a5323c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:16.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:16.814+0000 7f808a5323c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:17.656 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-15T17:53:17.669 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:17.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:17.754+0000 7fb452ac03c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-15T17:53:17.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:17.758+0000 7fb452ac03c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-15T17:53:17.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:17.758+0000 7fb452ac03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-15T17:53:17.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:17.758+0000 7fb452ac03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-15T17:53:17.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:17.758+0000 7fb452ac03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-15T17:53:17.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:17.758+0000 7fb452ac03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-15T17:53:18.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:18.310+0000 7fb452ac03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:19.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:19.094+0000 7fb452ac03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:19.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:19.878+0000 7fb452ac03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:20.735 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-15T17:53:20.750 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:20.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:20.830+0000 7f924dbe83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-15T17:53:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:20.830+0000 7f924dbe83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-15T17:53:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:20.830+0000 7f924dbe83c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-15T17:53:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:20.830+0000 7f924dbe83c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-15T17:53:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:20.830+0000 7f924dbe83c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-15T17:53:20.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:20.830+0000 7f924dbe83c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-15T17:53:21.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:21.398+0000 7f924dbe83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:22.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:22.182+0000 7f924dbe83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:22.570 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:53:22.573 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:53:22.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:22.958+0000 7f924dbe83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-15T17:53:23.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-15T17:53:23.835 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-15T17:53:23.836 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-15T17:53:23.853 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-15T17:53:23.869 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-15T17:53:23.880 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.880 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-15T17:53:23.895 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.895 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-15T17:53:23.906 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.906 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-15T17:53:23.960 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:23.960 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-15T17:53:23.974 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:23.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-15T17:53:23.991 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:23.991 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-15T17:53:24.003 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.003 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-15T17:53:24.015 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.015 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-15T17:53:24.073 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.073 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-15T17:53:24.082 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.083 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-15T17:53:24.137 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.137 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-15T17:53:24.149 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:24.150 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-15T17:53:24.158 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:24.158 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-15T17:53:24.205 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.205 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-15T17:53:24.212 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:24.212 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-15T17:53:24.262 INFO:tasks.ceph:Adding keys to all mons... 2024-08-15T17:53:24.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-15T17:53:24.264 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-15T17:53:24.280 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2024-08-15T17:53:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB1QL5myei8LhAAur9jSJJeEx2EV6MHh0ILiQ== 2024-08-15T17:53:24.280 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-08-15T17:53:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB1QL5mvPjBNBAAieKNgU96svHx7vPDq1EMQw== 2024-08-15T17:53:24.280 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2024-08-15T17:53:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB1QL5mWSffNxAA8/rQfoO6UBnxjTWVgWBxUg== 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB4QL5mtVfTNBAAIc22r352BIfcol7MxhVBEg== 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB7QL5mfkDIORAAMHUms+6UWHmNqPQNLAy5jg== 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB/QL5mXKo9ABAAw+SU33tDtqQPfT9nBxt4xQ== 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCCQL5m/7C0AxAAgOWZmo2kuXSUk/BshfJ6QA== 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB1QL5m75KyMRAAizhpI7ACW6VlyhTvL9uLhw== 2024-08-15T17:53:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2QL5moIm+AhAATG191CEUklyNvb8cqiumww== 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2QL5mqBXNBRAAUKpQtLwbCiwZEWWxFqVw6w== 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCHQL5m/5XjJRAAMid90orphPuehQIJ3xQrmQ== 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCKQL5m0ZZuKRAAyqhqZJTdSEOY30hH0OJPHg== 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCNQL5mKctBLRAATaclaljbaSlpG35oMGYV0g== 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCQQL5mZay1MRAA6wpGClDVLvO0M9c/gh6pzQ== 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-08-15T17:53:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2QL5mUeDPCBAAoqRC25zbBCSHX+87Ir5SMA== 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi033.stdout:[client.2] 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2QL5mhb9wCxAAKZxUyvhhC5dXanUG9msgog== 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi033.stdout:[client.1] 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2QL5mUYH9DhAAQoUsKQup94K3zQgpVcIoCg== 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi033.stdout:[client.3] 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2QL5msz17ERAATWZSxBfTJBkxx0TqhQrfTQ== 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB1QL5myei8LhAAur9jSJJeEx2EV6MHh0ILiQ== 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB1QL5mvPjBNBAAieKNgU96svHx7vPDq1EMQw== 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-08-15T17:53:24.283 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB1QL5mWSffNxAA8/rQfoO6UBnxjTWVgWBxUg== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB4QL5mtVfTNBAAIc22r352BIfcol7MxhVBEg== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB7QL5mfkDIORAAMHUms+6UWHmNqPQNLAy5jg== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB/QL5mXKo9ABAAw+SU33tDtqQPfT9nBxt4xQ== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCQL5m/7C0AxAAgOWZmo2kuXSUk/BshfJ6QA== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB1QL5m75KyMRAAizhpI7ACW6VlyhTvL9uLhw== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB2QL5moIm+AhAATG191CEUklyNvb8cqiumww== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB2QL5mqBXNBRAAUKpQtLwbCiwZEWWxFqVw6w== 2024-08-15T17:53:24.284 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCHQL5m/5XjJRAAMid90orphPuehQIJ3xQrmQ== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCKQL5m0ZZuKRAAyqhqZJTdSEOY30hH0OJPHg== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCNQL5mKctBLRAATaclaljbaSlpG35oMGYV0g== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCQQL5mZay1MRAA6wpGClDVLvO0M9c/gh6pzQ== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB2QL5mUeDPCBAAoqRC25zbBCSHX+87Ir5SMA== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[client.2] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB2QL5mhb9wCxAAKZxUyvhhC5dXanUG9msgog== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[client.1] 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB2QL5mUYH9DhAAQoUsKQup94K3zQgpVcIoCg== 2024-08-15T17:53:24.285 INFO:teuthology.orchestra.run.smithi105.stdout:[client.3] 2024-08-15T17:53:24.286 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQB2QL5msz17ERAATWZSxBfTJBkxx0TqhQrfTQ== 2024-08-15T17:53:24.286 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-15T17:53:24.324 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-15T17:53:24.371 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.373 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.421 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.469 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.553 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.599 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.601 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.644 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.689 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.735 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-15T17:53:24.737 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-15T17:53:24.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.782 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.870 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-15T17:53:24.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.919 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:24.958 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:25.044 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:25.047 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:25.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:25.099 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-15T17:53:25.142 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.144 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.237 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.240 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.289 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.373 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-15T17:53:25.425 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-15T17:53:25.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-15T17:53:25.441 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-15T17:53:25.494 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-15T17:53:25.508 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-15T17:53:25.525 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-15T17:53:25.622 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-15T17:53:25.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-15T17:53:25.645 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-15T17:53:25.695 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-15T17:53:25.707 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:25.711 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-15T17:53:25.757 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-15T17:53:25.758 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-15T17:53:25.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-15T17:53:25.760 INFO:tasks.ceph.mon.a:Started 2024-08-15T17:53:25.760 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-15T17:53:25.760 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-15T17:53:25.762 INFO:tasks.ceph.mon.b:Started 2024-08-15T17:53:25.762 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-15T17:53:25.762 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-15T17:53:25.764 INFO:tasks.ceph.mon.c:Started 2024-08-15T17:53:25.765 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-15T17:53:25.765 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-15T17:53:25.765 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-15T17:53:25.767 INFO:tasks.ceph.mgr.y:Started 2024-08-15T17:53:25.767 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-15T17:53:25.767 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-15T17:53:25.770 INFO:tasks.ceph.mgr.x:Started 2024-08-15T17:53:25.770 INFO:tasks.ceph:Setting crush tunables to default 2024-08-15T17:53:25.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2024-08-15T17:53:25.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 Processor -- start 2024-08-15T17:53:25.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 -- start start 2024-08-15T17:53:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 0x7fc1d015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1d00c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00cc350 con 0x7fc1d00b0390 2024-08-15T17:53:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00ca760 con 0x7fc1d00cbcc0 2024-08-15T17:53:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00cd3f0 con 0x7fc1d015d9f0 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 0x7fc1d015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 0x7fc1d015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36494/0 (socket says 172.21.15.33:36494) 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 -- 172.21.15.33:0/3763812562 learned_addr learned my addr 172.21.15.33:0/3763812562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 -- 172.21.15.33:0/3763812562 >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 msgr2=0x7fc1d015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 -- 172.21.15.33:0/3763812562 >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 msgr2=0x7fc1d015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cf7fe700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1d00c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/3763812562 >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 0x7fc1d015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/3763812562 >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 0x7fc1d015d4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cf7fe700 1 -- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 msgr2=0x7fc1d00c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cf7fe700 1 -- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 msgr2=0x7fc1d00c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-15T17:53:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cf7fe700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1d00c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-15T17:53:25.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.883+0000 7fc1cf7fe700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1d00c2c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-15T17:53:25.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434703405 0 0) 0x7fc1d00cc350 con 0x7fc1d00b0390 2024-08-15T17:53:25.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b0003570 con 0x7fc1d00b0390 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913553561 0 0) 0x7fc1b0003570 con 0x7fc1d00b0390 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 msgr2=0x7fc1d00c2c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1d00c2c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 msgr2=0x7fc1d015d4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 --2- 172.21.15.33:0/3763812562 >> v2:172.21.15.33:3300/0 conn(0x7fc1d00cbcc0 0x7fc1d015d4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00cc630 con 0x7fc1d00b0390 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fc1b8001470 con 0x7fc1d00b0390 2024-08-15T17:53:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 >> v1:172.21.15.105:6789/0 conn(0x7fc1d00b0390 legacy=0x7fc1d015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.923+0000 7fc1ce7fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1b0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ce7fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1b0004090 0x7fc1b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ce7fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004d50 0x7fc1b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00ca760 con 0x7fc1b0004d50 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000bb70 con 0x7fc1b0004090 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000bd30 con 0x7fc1d015d9f0 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1cf7fe700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004d50 0x7fc1b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ceffd700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1b0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1b0004090 0x7fc1b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 -- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 msgr2=0x7fc1b0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d015d9f0 0x7fc1b0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 -- 172.21.15.33:0/3763812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004d50 msgr2=0x7fc1b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004d50 0x7fc1b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 -- 172.21.15.33:0/3763812562 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0003570 con 0x7fc1b0004090 2024-08-15T17:53:25.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1cf7fe700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004d50 0x7fc1b00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:25.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1b0004090 0x7fc1b0004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009060 tx=0x7fc1c0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54a1338af422e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:25.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.927+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000c070 con 0x7fc1b0004090 2024-08-15T17:53:25.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000e5e0 con 0x7fc1b0004090 2024-08-15T17:53:25.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1ce7fc700 1 -- 172.21.15.33:0/3763812562 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000e770 con 0x7fc1b0004090 2024-08-15T17:53:25.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cffff700 1 -- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1b0004090 msgr2=0x7fc1b0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:25.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cffff700 1 --2- 172.21.15.33:0/3763812562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1b0004090 0x7fc1b0004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009060 tx=0x7fc1c0008040 comp rx=0 tx=0).stop 2024-08-15T17:53:25.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cf7fe700 1 -- 172.21.15.33:0/3763812562 reap_dead start 2024-08-15T17:53:25.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cffff700 1 -- 172.21.15.33:0/3763812562 shutdown_connections 2024-08-15T17:53:25.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cffff700 1 -- 172.21.15.33:0/3763812562 >> 172.21.15.33:0/3763812562 conn(0x7fc1d00cdee0 msgr2=0x7fc1d00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:25.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cffff700 1 -- 172.21.15.33:0/3763812562 shutdown_connections 2024-08-15T17:53:25.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.931+0000 7fc1cffff700 1 -- 172.21.15.33:0/3763812562 wait complete. 2024-08-15T17:53:25.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 Processor -- start 2024-08-15T17:53:25.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 -- start start 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004090 0x7fc1d01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d00c5550 0x7fc1d00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d00c5f00 0x7fc1d00c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00c68b0 con 0x7fc1b0004090 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01563b0 con 0x7fc1d00c5f00 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00b0ef0 con 0x7fc1d00c5550 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004090 0x7fc1d01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cf7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d00c5f00 0x7fc1d00c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cf7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d00c5f00 0x7fc1d00c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:56448/0 (socket says 172.21.15.33:56448) 2024-08-15T17:53:25.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1cf7fe700 1 -- 172.21.15.33:0/553285509 learned_addr learned my addr 172.21.15.33:0/553285509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1c67fc700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d00c5550 0x7fc1d00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 -- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d00c5550 msgr2=0x7fc1d00c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d00c5550 0x7fc1d00c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 -- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d00c5f00 msgr2=0x7fc1d00c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d00c5f00 0x7fc1d00c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 -- 172.21.15.33:0/553285509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0155b10 con 0x7fc1b0004090 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1ceffd700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004090 0x7fc1d01554a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8000c00 tx=0x7fc1b8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800d8f0 con 0x7fc1b0004090 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.935+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800da50 con 0x7fc1b0004090 2024-08-15T17:53:25.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.939+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0155df0 con 0x7fc1b0004090 2024-08-15T17:53:25.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.939+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800de10 con 0x7fc1b0004090 2024-08-15T17:53:25.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.939+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d00c5030 con 0x7fc1b0004090 2024-08-15T17:53:25.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.939+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc1b8014680 con 0x7fc1b0004090 2024-08-15T17:53:25.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.939+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc1b801d750 con 0x7fc1b0004090 2024-08-15T17:53:25.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.939+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d00638f0 con 0x7fc1b0004090 2024-08-15T17:53:25.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:25.943+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc1b803c7a0 con 0x7fc1b0004090 2024-08-15T17:53:26.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.015+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc1d00cba70 con 0x7fc1b0004090 2024-08-15T17:53:26.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1c77fe700 1 -- 172.21.15.33:0/553285509 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc1b802b020 con 0x7fc1b0004090 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004090 msgr2=0x7fc1d01554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004090 0x7fc1d01554a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8000c00 tx=0x7fc1b8007830 comp rx=0 tx=0).stop 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 shutdown_connections 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d00c5f00 0x7fc1d00c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d00c5550 0x7fc1d00c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 --2- 172.21.15.33:0/553285509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b0004090 0x7fc1d01554a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 >> 172.21.15.33:0/553285509 conn(0x7fc1d00cdee0 msgr2=0x7fc1d006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 shutdown_connections 2024-08-15T17:53:26.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:26.019+0000 7fc1cffff700 1 -- 172.21.15.33:0/553285509 wait complete. 2024-08-15T17:53:26.024 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-08-15T17:53:26.034 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-15T17:53:26.035 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:26.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-15T17:53:26.049 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:26.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-15T17:53:26.059 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:26.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-15T17:53:26.068 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-15T17:53:26.068 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-15T17:53:26.081 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:26.081 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-15T17:53:26.098 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:26.099 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-15T17:53:26.107 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:26.103+0000 7f6a10e2e000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-15T17:53:26.127 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:26.126+0000 7f2b71467000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-15T17:53:26.141 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:26.142 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-15T17:53:26.197 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-08-15T17:53:26.197 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-15T17:53:26.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new bf75f1a8-294e-48b8-b111-46fa1bedfa03 0 2024-08-15T17:53:26.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.310+0000 7f8d1132c700 1 Processor -- start 2024-08-15T17:53:26.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.310+0000 7f8d1132c700 1 -- start start 2024-08-15T17:53:26.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8d0c068b20 0x7f8d0c160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0ae490 con 0x7f8d0c1552a0 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c156d90 con 0x7f8d0c0686a0 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0ae920 con 0x7f8d0c068b20 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d03fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f8d0c0686a0 0x7f8d0c155670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:33392/0 (socket says 172.21.15.105:33392) 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d03fff700 1 -- 172.21.15.105:0/1297910728 learned_addr learned my addr 172.21.15.105:0/1297910728 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d10b2b700 1 --2- 172.21.15.105:0/1297910728 >> v2:172.21.15.33:3300/0 conn(0x7f8d0c068b20 0x7f8d0c160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d0b7fe700 1 -- 172.21.15.105:0/1297910728 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991069869 0 0) 0x7f8d0c156d90 con 0x7f8d0c0686a0 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d0b7fe700 1 -- 172.21.15.105:0/1297910728 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf8003570 con 0x7f8d0c0686a0 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d10b2b700 1 -- 172.21.15.105:0/1297910728 >> v1:172.21.15.105:6789/0 conn(0x7f8d0c0686a0 legacy=0x7f8d0c155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d10b2b700 1 -- 172.21.15.105:0/1297910728 >> v1:172.21.15.33:6789/0 conn(0x7f8d0c1552a0 legacy=0x7f8d0c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d10b2b700 1 -- 172.21.15.105:0/1297910728 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0ad880 con 0x7f8d0c068b20 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d10b2b700 1 --2- 172.21.15.105:0/1297910728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c160530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400af70 tx=0x7f8d0400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27475775dc61140d server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d0b7fe700 1 -- 172.21.15.105:0/1297910728 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400f070 con 0x7f8d0c068b20 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d0b7fe700 1 -- 172.21.15.105:0/1297910728 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0400a2e0 con 0x7f8d0c068b20 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d0b7fe700 1 -- 172.21.15.105:0/1297910728 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400cc70 con 0x7f8d0c068b20 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- 172.21.15.105:0/1297910728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 msgr2=0x7f8d0c160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 --2- 172.21.15.105:0/1297910728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c160530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400af70 tx=0x7f8d0400a890 comp rx=0 tx=0).stop 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- 172.21.15.105:0/1297910728 shutdown_connections 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 --2- 172.21.15.105:0/1297910728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c160530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- 172.21.15.105:0/1297910728 >> 172.21.15.105:0/1297910728 conn(0x7f8d0c06e350 msgr2=0x7f8d0c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- 172.21.15.105:0/1297910728 shutdown_connections 2024-08-15T17:53:26.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.314+0000 7f8d1132c700 1 -- 172.21.15.105:0/1297910728 wait complete. 2024-08-15T17:53:26.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 Processor -- start 2024-08-15T17:53:26.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 -- start start 2024-08-15T17:53:26.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d0c0686a0 0x7f8d0c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 0x7f8d0c0c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0cc310 con 0x7f8d0c068b20 2024-08-15T17:53:26.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0c27b0 con 0x7f8d0c1552a0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d1132c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0c1ba0 con 0x7f8d0c0686a0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 0x7f8d0c0c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 0x7f8d0c0c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35268/0 (socket says 172.21.15.105:35268) 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 -- 172.21.15.105:0/3219446488 learned_addr learned my addr 172.21.15.105:0/3219446488 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d0c0686a0 0x7f8d0c0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d03fff700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 -- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d0c0686a0 msgr2=0x7f8d0c0c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d0c0686a0 0x7f8d0c0c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 -- 172.21.15.105:0/3219446488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 msgr2=0x7f8d0c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 -- 172.21.15.105:0/3219446488 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0400ab30 con 0x7f8d0c1552a0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d10b2b700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 0x7f8d0c0c2c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400ab00 tx=0x7f8d04019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.318+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04009ad0 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04009c70 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04027410 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c0c1e80 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c0c2440 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8d04003020 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8d0401d410 con 0x7f8d0c1552a0 2024-08-15T17:53:26.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.322+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c156d80 con 0x7f8d0c1552a0 2024-08-15T17:53:26.326 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.326+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8d0c156d80 con 0x7f8d0c1552a0 2024-08-15T17:53:26.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.402+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf75f1a8-294e-48b8-b111-46fa1bedfa03", "id": 0} v 0) v1 -- 0x7f8d0c0c31e0 con 0x7f8d0c1552a0 2024-08-15T17:53:26.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.410+0000 7f8d08ff9700 1 -- 172.21.15.105:0/3219446488 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf75f1a8-294e-48b8-b111-46fa1bedfa03", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8d0402c060 con 0x7f8d0c1552a0 2024-08-15T17:53:26.412 INFO:teuthology.orchestra.run.smithi105.stdout:0 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 msgr2=0x7f8d0c0c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 0x7f8d0c0c2c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400ab00 tx=0x7f8d04019000 comp rx=0 tx=0).stop 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 shutdown_connections 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0c1552a0 0x7f8d0c0c2c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d0c068b20 0x7f8d0c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 --2- 172.21.15.105:0/3219446488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d0c0686a0 0x7f8d0c0c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 >> 172.21.15.105:0/3219446488 conn(0x7f8d0c06e350 msgr2=0x7f8d0c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 shutdown_connections 2024-08-15T17:53:26.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.414+0000 7f8d1132c700 1 -- 172.21.15.105:0/3219446488 wait complete. 2024-08-15T17:53:26.431 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46 1 2024-08-15T17:53:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 Processor -- start 2024-08-15T17:53:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- start start 2024-08-15T17:53:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79f8068db0 0x7f79f8155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f80ae490 con 0x7f79f80b2370 2024-08-15T17:53:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80ae920 con 0x7f79f8068db0 2024-08-15T17:53:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80af040 con 0x7f79f81552a0 2024-08-15T17:53:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57580/0 (socket says 172.21.15.105:57580) 2024-08-15T17:53:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 -- 172.21.15.105:0/1820829272 learned_addr learned my addr 172.21.15.105:0/1820829272 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fd7cd700 1 --2- 172.21.15.105:0/1820829272 >> v2:172.21.15.33:3300/0 conn(0x7f79f8068db0 0x7f79f8155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 -- 172.21.15.105:0/1820829272 >> v2:172.21.15.33:3300/0 conn(0x7f79f8068db0 msgr2=0x7f79f8155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 --2- 172.21.15.105:0/1820829272 >> v2:172.21.15.33:3300/0 conn(0x7f79f8068db0 0x7f79f8155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 -- 172.21.15.105:0/1820829272 >> v1:172.21.15.33:6789/0 conn(0x7f79f80b2370 legacy=0x7f79f80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 -- 172.21.15.105:0/1820829272 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80ad880 con 0x7f79f81552a0 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fcfcc700 1 --2- 172.21.15.105:0/1820829272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80b1e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00bc50 tx=0x7f79ec00b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656a04b611102ee1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79f77fe700 1 -- 172.21.15.105:0/1820829272 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec00dbf0 con 0x7f79f81552a0 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79f77fe700 1 -- 172.21.15.105:0/1820829272 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec00dd50 con 0x7f79f81552a0 2024-08-15T17:53:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79f77fe700 1 -- 172.21.15.105:0/1820829272 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0196b0 con 0x7f79f81552a0 2024-08-15T17:53:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- 172.21.15.105:0/1820829272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 msgr2=0x7f79f80b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 --2- 172.21.15.105:0/1820829272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80b1e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00bc50 tx=0x7f79ec00b4f0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- 172.21.15.105:0/1820829272 shutdown_connections 2024-08-15T17:53:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 --2- 172.21.15.105:0/1820829272 >> v2:172.21.15.33:3300/0 conn(0x7f79f8068db0 0x7f79f8155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 --2- 172.21.15.105:0/1820829272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80b1e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.538+0000 7f79fdfce700 1 -- 172.21.15.105:0/1820829272 >> 172.21.15.105:0/1820829272 conn(0x7f79f806e350 msgr2=0x7f79f806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 -- 172.21.15.105:0/1820829272 shutdown_connections 2024-08-15T17:53:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 -- 172.21.15.105:0/1820829272 wait complete. 2024-08-15T17:53:26.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 Processor -- start 2024-08-15T17:53:26.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 -- start start 2024-08-15T17:53:26.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79f8068db0 0x7f79f814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79f80b2370 0x7f79f81690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80a9860 con 0x7f79f8068db0 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80a9ab0 con 0x7f79f80b2370 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.542+0000 7f79fdfce700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80a9d90 con 0x7f79f81552a0 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79f80b2370 0x7f79f81690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57592/0 (socket says 172.21.15.105:57592) 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 -- 172.21.15.105:0/950198258 learned_addr learned my addr 172.21.15.105:0/950198258 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:26.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fcfcc700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79f8068db0 0x7f79f814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 -- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79f80b2370 msgr2=0x7f79f81690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79f80b2370 0x7f79f81690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 -- 172.21.15.105:0/950198258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79f8068db0 msgr2=0x7f79f814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79f8068db0 0x7f79f814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 -- 172.21.15.105:0/950198258 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec00b790 con 0x7f79f81552a0 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f7fff700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79f80b2370 0x7f79f81690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:26.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fd7cd700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80c1ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009ef0 tx=0x7f79f000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f000cb70 con 0x7f79f81552a0 2024-08-15T17:53:26.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f000f040 con 0x7f79f81552a0 2024-08-15T17:53:26.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f80aa070 con 0x7f79f81552a0 2024-08-15T17:53:26.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0014480 con 0x7f79f81552a0 2024-08-15T17:53:26.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f80abad0 con 0x7f79f81552a0 2024-08-15T17:53:26.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f79f0014ac0 con 0x7f79f81552a0 2024-08-15T17:53:26.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f79f001dc70 con 0x7f79f81552a0 2024-08-15T17:53:26.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.546+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f80aa570 con 0x7f79f81552a0 2024-08-15T17:53:26.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.550+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f79f003b7a0 con 0x7f79f81552a0 2024-08-15T17:53:26.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.630+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46", "id": 1} v 0) v1 -- 0x7f79f80638f0 con 0x7f79f81552a0 2024-08-15T17:53:26.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.634+0000 7f79f4ff9700 1 -- 172.21.15.105:0/950198258 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f79f002a070 con 0x7f79f81552a0 2024-08-15T17:53:26.635 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-08-15T17:53:26.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 msgr2=0x7f79f80c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80c1ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009ef0 tx=0x7f79f000b040 comp rx=0 tx=0).stop 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 shutdown_connections 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79f80b2370 0x7f79f81690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79f81552a0 0x7f79f80c1ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 --2- 172.21.15.105:0/950198258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79f8068db0 0x7f79f814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 >> 172.21.15.105:0/950198258 conn(0x7f79f806e350 msgr2=0x7f79f81561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 shutdown_connections 2024-08-15T17:53:26.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.638+0000 7f79fdfce700 1 -- 172.21.15.105:0/950198258 wait complete. 2024-08-15T17:53:26.653 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 27432364-0499-4f40-b12b-8fdffc29387b 2 2024-08-15T17:53:26.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.762+0000 7fbfcd7cb700 1 Processor -- start 2024-08-15T17:53:26.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.762+0000 7fbfcd7cb700 1 -- start start 2024-08-15T17:53:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.762+0000 7fbfcd7cb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc81552a0 0x7fbfc80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbfc8068db0 0x7fbfc8155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80ae490 con 0x7fbfc80b2370 2024-08-15T17:53:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc80ae920 con 0x7fbfc8068db0 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80af040 con 0x7fbfc81552a0 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc77fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fbfc80b2370 0x7fbfc80686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:33408/0 (socket says 172.21.15.105:33408) 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc77fe700 1 -- 172.21.15.105:0/260106157 learned_addr learned my addr 172.21.15.105:0/260106157 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc81552a0 0x7fbfc80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfccfca700 1 --2- 172.21.15.105:0/260106157 >> v2:172.21.15.33:3300/0 conn(0x7fbfc8068db0 0x7fbfc8155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc6ffd700 1 -- 172.21.15.105:0/260106157 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982020654 0 0) 0x7fbfc80ae490 con 0x7fbfc80b2370 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc6ffd700 1 -- 172.21.15.105:0/260106157 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb0003570 con 0x7fbfc80b2370 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc7fff700 1 -- 172.21.15.105:0/260106157 >> v2:172.21.15.33:3300/0 conn(0x7fbfc8068db0 msgr2=0x7fbfc8155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc7fff700 1 --2- 172.21.15.105:0/260106157 >> v2:172.21.15.33:3300/0 conn(0x7fbfc8068db0 0x7fbfc8155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc7fff700 1 -- 172.21.15.105:0/260106157 >> v1:172.21.15.105:6789/0 conn(0x7fbfc80b2370 legacy=0x7fbfc80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc7fff700 1 -- 172.21.15.105:0/260106157 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80ad880 con 0x7fbfc81552a0 2024-08-15T17:53:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfccfca700 1 --2- 172.21.15.105:0/260106157 >> v2:172.21.15.33:3300/0 conn(0x7fbfc8068db0 0x7fbfc8155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc7fff700 1 --2- 172.21.15.105:0/260106157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc81552a0 0x7fbfc80b1e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800aa90 tx=0x7fbfb800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3affe1fa015b2f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc6ffd700 1 -- 172.21.15.105:0/260106157 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800c970 con 0x7fbfc81552a0 2024-08-15T17:53:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc6ffd700 1 -- 172.21.15.105:0/260106157 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb800cad0 con 0x7fbfc81552a0 2024-08-15T17:53:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfc6ffd700 1 -- 172.21.15.105:0/260106157 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800ce70 con 0x7fbfc81552a0 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/260106157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc81552a0 msgr2=0x7fbfc80b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/260106157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc81552a0 0x7fbfc80b1e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800aa90 tx=0x7fbfb800a330 comp rx=0 tx=0).stop 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/260106157 shutdown_connections 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/260106157 >> v2:172.21.15.33:3300/0 conn(0x7fbfc8068db0 0x7fbfc8155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/260106157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc81552a0 0x7fbfc80b1e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/260106157 >> 172.21.15.105:0/260106157 conn(0x7fbfc806e350 msgr2=0x7fbfc806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/260106157 shutdown_connections 2024-08-15T17:53:26.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.766+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/260106157 wait complete. 2024-08-15T17:53:26.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 Processor -- start 2024-08-15T17:53:26.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 -- start start 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfc8068db0 0x7fbfc816c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 0x7fbfc80aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc81552a0 0x7fbfc8144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80aba20 con 0x7fbfc81552a0 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81454d0 con 0x7fbfc8068db0 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80aae10 con 0x7fbfc80b2370 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 0x7fbfc80aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfc8068db0 0x7fbfc816c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 0x7fbfc80aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57616/0 (socket says 172.21.15.105:57616) 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc77fe700 1 -- 172.21.15.105:0/2262774004 learned_addr learned my addr 172.21.15.105:0/2262774004 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfccfca700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc81552a0 0x7fbfc8144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 -- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 msgr2=0x7fbfc80aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 0x7fbfc80aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 -- 172.21.15.105:0/2262774004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc81552a0 msgr2=0x7fbfc8144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc81552a0 0x7fbfc8144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 -- 172.21.15.105:0/2262774004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb800a5d0 con 0x7fbfc8068db0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc77fe700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 0x7fbfc80aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfc7fff700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfc8068db0 0x7fbfc816c870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8017000 tx=0x7fbfb801a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8018e10 con 0x7fbfc8068db0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8010600 con 0x7fbfc8068db0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc80ab0f0 con 0x7fbfc8068db0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80109c0 con 0x7fbfc8068db0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc80ab6b0 con 0x7fbfc8068db0 2024-08-15T17:53:26.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbfb8022440 con 0x7fbfc8068db0 2024-08-15T17:53:26.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.770+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fbfb8010d70 con 0x7fbfc8068db0 2024-08-15T17:53:26.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.774+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80638f0 con 0x7fbfc8068db0 2024-08-15T17:53:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.774+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbfb800b040 con 0x7fbfc8068db0 2024-08-15T17:53:26.824 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:26.823+0000 7f6a10e2e000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-15T17:53:26.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.854+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27432364-0499-4f40-b12b-8fdffc29387b", "id": 2} v 0) v1 -- 0x7fbfc80ad2f0 con 0x7fbfc8068db0 2024-08-15T17:53:26.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfaffff700 1 -- 172.21.15.105:0/2262774004 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27432364-0499-4f40-b12b-8fdffc29387b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbfb80228d0 con 0x7fbfc8068db0 2024-08-15T17:53:26.861 INFO:teuthology.orchestra.run.smithi105.stdout:2 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfc8068db0 msgr2=0x7fbfc816c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfc8068db0 0x7fbfc816c870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8017000 tx=0x7fbfb801a000 comp rx=0 tx=0).stop 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 shutdown_connections 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc81552a0 0x7fbfc8144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfc80b2370 0x7fbfc80aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 --2- 172.21.15.105:0/2262774004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfc8068db0 0x7fbfc816c870 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 >> 172.21.15.105:0/2262774004 conn(0x7fbfc806e350 msgr2=0x7fbfc8158710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 shutdown_connections 2024-08-15T17:53:26.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.862+0000 7fbfcd7cb700 1 -- 172.21.15.105:0/2262774004 wait complete. 2024-08-15T17:53:26.875 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 2b25f111-4c63-4014-a5de-4174852171c5 3 2024-08-15T17:53:26.883 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:26.879+0000 7f6a10e2e000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-15T17:53:26.894 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:26.894+0000 7f2b71467000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-15T17:53:26.954 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:26.954+0000 7f2b71467000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-15T17:53:26.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.978+0000 7ffa77fff700 1 Processor -- start 2024-08-15T17:53:26.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.978+0000 7ffa77fff700 1 -- start start 2024-08-15T17:53:26.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa780aede0 0x7ffa780b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa78159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa78067cd0 con 0x7ffa780af1b0 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa780b0050 con 0x7ffa780aede0 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7815a3a0 con 0x7ffa78067510 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa78159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa78159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57630/0 (socket says 172.21.15.105:57630) 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 -- 172.21.15.105:0/1166344659 learned_addr learned my addr 172.21.15.105:0/1166344659 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa76ffd700 1 --2- 172.21.15.105:0/1166344659 >> v2:172.21.15.33:3300/0 conn(0x7ffa780aede0 0x7ffa780b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 -- 172.21.15.105:0/1166344659 >> v2:172.21.15.33:3300/0 conn(0x7ffa780aede0 msgr2=0x7ffa780b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:26.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 --2- 172.21.15.105:0/1166344659 >> v2:172.21.15.33:3300/0 conn(0x7ffa780aede0 0x7ffa780b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 -- 172.21.15.105:0/1166344659 >> v1:172.21.15.33:6789/0 conn(0x7ffa780af1b0 legacy=0x7ffa78066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 -- 172.21.15.105:0/1166344659 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780afa00 con 0x7ffa78067510 2024-08-15T17:53:26.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa777fe700 1 --2- 172.21.15.105:0/1166344659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa78159780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009f20 tx=0x7ffa70009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c157d6cd56525511 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa75ffb700 1 -- 172.21.15.105:0/1166344659 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000e070 con 0x7ffa78067510 2024-08-15T17:53:26.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa75ffb700 1 -- 172.21.15.105:0/1166344659 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000b9d0 con 0x7ffa78067510 2024-08-15T17:53:26.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa75ffb700 1 -- 172.21.15.105:0/1166344659 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700092e0 con 0x7ffa78067510 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- 172.21.15.105:0/1166344659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 msgr2=0x7ffa78159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 --2- 172.21.15.105:0/1166344659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa78159780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009f20 tx=0x7ffa70009840 comp rx=0 tx=0).stop 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- 172.21.15.105:0/1166344659 shutdown_connections 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 --2- 172.21.15.105:0/1166344659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa78159780 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 --2- 172.21.15.105:0/1166344659 >> v2:172.21.15.33:3300/0 conn(0x7ffa780aede0 0x7ffa780b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- 172.21.15.105:0/1166344659 >> 172.21.15.105:0/1166344659 conn(0x7ffa780682c0 msgr2=0x7ffa780686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- 172.21.15.105:0/1166344659 shutdown_connections 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.982+0000 7ffa77fff700 1 -- 172.21.15.105:0/1166344659 wait complete. 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 Processor -- start 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 -- start start 2024-08-15T17:53:26.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa7816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa780aede0 0x7ffa7816c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 0x7ffa78158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7816cb80 con 0x7ffa780aede0 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c8c00 con 0x7ffa780af1b0 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c7dd0 con 0x7ffa78067510 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 0x7ffa78158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa76ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa7816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 0x7ffa78158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35288/0 (socket says 172.21.15.105:35288) 2024-08-15T17:53:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 -- 172.21.15.105:0/3360627027 learned_addr learned my addr 172.21.15.105:0/3360627027 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa76ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa7816a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57640/0 (socket says 172.21.15.105:57640) 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa767fc700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa780aede0 0x7ffa7816c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 -- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 msgr2=0x7ffa7816a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa7816a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 -- 172.21.15.105:0/3360627027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa780aede0 msgr2=0x7ffa7816c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa780aede0 0x7ffa7816c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 -- 172.21.15.105:0/3360627027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009ae0 con 0x7ffa780af1b0 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa777fe700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 0x7ffa78158b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa780b1600 tx=0x7ffa70018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70008b10 con 0x7ffa780af1b0 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70008cb0 con 0x7ffa780af1b0 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa780c80b0 con 0x7ffa780af1b0 2024-08-15T17:53:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700266b0 con 0x7ffa780af1b0 2024-08-15T17:53:26.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa780c8890 con 0x7ffa780af1b0 2024-08-15T17:53:26.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ffa70003040 con 0x7ffa780af1b0 2024-08-15T17:53:26.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.986+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7ffa7001d910 con 0x7ffa780af1b0 2024-08-15T17:53:26.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.990+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa780c8d70 con 0x7ffa780af1b0 2024-08-15T17:53:26.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:26.990+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ffa70021070 con 0x7ffa780af1b0 2024-08-15T17:53:27.008 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:27.007+0000 7f6a10e2e000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-15T17:53:27.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.070+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b25f111-4c63-4014-a5de-4174852171c5", "id": 3} v 0) v1 -- 0x7ffa780638f0 con 0x7ffa780af1b0 2024-08-15T17:53:27.070 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:27.070+0000 7f2b71467000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-15T17:53:27.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.078+0000 7ffa6effd700 1 -- 172.21.15.105:0/3360627027 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b25f111-4c63-4014-a5de-4174852171c5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa7001dbb0 con 0x7ffa780af1b0 2024-08-15T17:53:27.079 INFO:teuthology.orchestra.run.smithi105.stdout:3 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 msgr2=0x7ffa78158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 0x7ffa78158b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa780b1600 tx=0x7ffa70018000 comp rx=0 tx=0).stop 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 shutdown_connections 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa780af1b0 0x7ffa78158b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa780aede0 0x7ffa7816c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 --2- 172.21.15.105:0/3360627027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa78067510 0x7ffa7816a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 >> 172.21.15.105:0/3360627027 conn(0x7ffa780682c0 msgr2=0x7ffa780cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 shutdown_connections 2024-08-15T17:53:27.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.082+0000 7ffa77fff700 1 -- 172.21.15.105:0/3360627027 wait complete. 2024-08-15T17:53:27.095 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e 4 2024-08-15T17:53:27.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 Processor -- start 2024-08-15T17:53:27.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 -- start start 2024-08-15T17:53:27.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe394154b60 0x7fe3940b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3940b2c40 0x7fe3940aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe3940af340 0x7fe394067430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940af7a0 con 0x7fe3940af340 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39415ad10 con 0x7fe3940b2c40 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe399489700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39415aff0 con 0x7fe394154b60 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3940b2c40 0x7fe3940aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe392ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe394154b60 0x7fe3940b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3940b2c40 0x7fe3940aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35294/0 (socket says 172.21.15.105:35294) 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 -- 172.21.15.105:0/441661324 learned_addr learned my addr 172.21.15.105:0/441661324 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3937fe700 1 --2- 172.21.15.105:0/441661324 >> v2:172.21.15.33:3300/0 conn(0x7fe3940af340 0x7fe394067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 -- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe394154b60 msgr2=0x7fe3940b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 --2- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe394154b60 0x7fe3940b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 -- 172.21.15.105:0/441661324 >> v2:172.21.15.33:3300/0 conn(0x7fe3940af340 msgr2=0x7fe394067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:27.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 --2- 172.21.15.105:0/441661324 >> v2:172.21.15.33:3300/0 conn(0x7fe3940af340 0x7fe394067430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3927fc700 1 -- 172.21.15.105:0/441661324 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39415b2d0 con 0x7fe3940b2c40 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe392ffd700 1 --2- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe394154b60 0x7fe3940b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.198+0000 7fe3937fe700 1 --2- 172.21.15.105:0/441661324 >> v2:172.21.15.33:3300/0 conn(0x7fe3940af340 0x7fe394067430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe3927fc700 1 --2- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe3940aee00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe39406dc80 tx=0x7fe388009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43f53f38246a4f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe391ffb700 1 -- 172.21.15.105:0/441661324 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388009e70 con 0x7fe3940b2c40 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe391ffb700 1 -- 172.21.15.105:0/441661324 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38800b860 con 0x7fe3940b2c40 2024-08-15T17:53:27.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe391ffb700 1 -- 172.21.15.105:0/441661324 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800bc00 con 0x7fe3940b2c40 2024-08-15T17:53:27.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 -- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 msgr2=0x7fe3940aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 --2- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe3940aee00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe39406dc80 tx=0x7fe388009250 comp rx=0 tx=0).stop 2024-08-15T17:53:27.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 -- 172.21.15.105:0/441661324 shutdown_connections 2024-08-15T17:53:27.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 --2- 172.21.15.105:0/441661324 >> v2:172.21.15.33:3300/0 conn(0x7fe3940af340 0x7fe394067430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 --2- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe3940aee00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 --2- 172.21.15.105:0/441661324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe394154b60 0x7fe3940b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 -- 172.21.15.105:0/441661324 >> 172.21.15.105:0/441661324 conn(0x7fe3940687a0 msgr2=0x7fe39406c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 -- 172.21.15.105:0/441661324 shutdown_connections 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 -- 172.21.15.105:0/441661324 wait complete. 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 Processor -- start 2024-08-15T17:53:27.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.202+0000 7fe399489700 1 -- start start 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 0x7fe394148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe394156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe394154b60 0x7fe394156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3941552e0 con 0x7fe394154b60 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39406b8f0 con 0x7fe3940b2c40 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe394159d80 con 0x7fe3940af340 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 0x7fe394148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 0x7fe394148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57660/0 (socket says 172.21.15.105:57660) 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe3927fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe394156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 -- 172.21.15.105:0/2575339221 learned_addr learned my addr 172.21.15.105:0/2575339221 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe3937fe700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe394154b60 0x7fe394156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 -- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 msgr2=0x7fe394156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe394156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 -- 172.21.15.105:0/2575339221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe394154b60 msgr2=0x7fe394156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe394154b60 0x7fe394156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 -- 172.21.15.105:0/2575339221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c009a20 con 0x7fe3940af340 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe3937fe700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe394154b60 0x7fe394156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe392ffd700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 0x7fe394148ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c0c0 tx=0x7fe38c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00ccb0 con 0x7fe3940af340 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00f040 con 0x7fe3940af340 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3880094f0 con 0x7fe3940af340 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c014480 con 0x7fe3940af340 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39415a340 con 0x7fe3940af340 2024-08-15T17:53:27.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe38c0147f0 con 0x7fe3940af340 2024-08-15T17:53:27.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fe38c01db90 con 0x7fe3940af340 2024-08-15T17:53:27.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.206+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3940645c0 con 0x7fe3940af340 2024-08-15T17:53:27.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.210+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe38c03c7a0 con 0x7fe3940af340 2024-08-15T17:53:27.250 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:27.247+0000 7f6a10e2e000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-15T17:53:27.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.286+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e", "id": 4} v 0) v1 -- 0x7fe394069e10 con 0x7fe3940af340 2024-08-15T17:53:27.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe37affd700 1 -- 172.21.15.105:0/2575339221 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe38c02b070 con 0x7fe3940af340 2024-08-15T17:53:27.294 INFO:teuthology.orchestra.run.smithi105.stdout:4 2024-08-15T17:53:27.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 msgr2=0x7fe394148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 0x7fe394148ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c0c0 tx=0x7fe38c00b040 comp rx=0 tx=0).stop 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 shutdown_connections 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b2c40 0x7fe394156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe394154b60 0x7fe394156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 --2- 172.21.15.105:0/2575339221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3940af340 0x7fe394148ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 >> 172.21.15.105:0/2575339221 conn(0x7fe3940687a0 msgr2=0x7fe39414aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 shutdown_connections 2024-08-15T17:53:27.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.294+0000 7fe399489700 1 -- 172.21.15.105:0/2575339221 wait complete. 2024-08-15T17:53:27.303 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:27.303+0000 7f6a10e2e000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-15T17:53:27.309 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 9a3a64f5-65b3-4388-b7de-f89a4ad2610a 5 2024-08-15T17:53:27.318 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:27.318+0000 7f2b71467000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-15T17:53:27.374 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:27.374+0000 7f2b71467000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-15T17:53:27.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 Processor -- start 2024-08-15T17:53:27.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 -- start start 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82e01552a0 0x7f82e00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82e0068db0 0x7f82e0155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00ae490 con 0x7f82e00b2370 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00ae920 con 0x7f82e01552a0 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82dffff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00af040 con 0x7f82e0068db0 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.410+0000 7f82df7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82e0068db0 0x7f82e0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82e0068db0 0x7f82e0155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35314/0 (socket says 172.21.15.105:35314) 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 -- 172.21.15.105:0/3148553924 learned_addr learned my addr 172.21.15.105:0/3148553924 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82deffd700 1 --2- 172.21.15.105:0/3148553924 >> v2:172.21.15.33:3300/0 conn(0x7f82e01552a0 0x7f82e00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 -- 172.21.15.105:0/3148553924 >> v2:172.21.15.33:3300/0 conn(0x7f82e01552a0 msgr2=0x7f82e00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 --2- 172.21.15.105:0/3148553924 >> v2:172.21.15.33:3300/0 conn(0x7f82e01552a0 0x7f82e00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 -- 172.21.15.105:0/3148553924 >> v1:172.21.15.105:6789/0 conn(0x7f82e00b2370 legacy=0x7f82e00686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 -- 172.21.15.105:0/3148553924 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00ad880 con 0x7f82e0068db0 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82ddffb700 1 -- 172.21.15.105:0/3148553924 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517255979 0 0) 0x7f82e00ae490 con 0x7f82e00b2370 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82df7fe700 1 --2- 172.21.15.105:0/3148553924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e0068db0 0x7f82e0155670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f82e01590c0 tx=0x7f82d8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d294ef2716a747 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82ddffb700 1 -- 172.21.15.105:0/3148553924 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80092e0 con 0x7f82e0068db0 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82ddffb700 1 -- 172.21.15.105:0/3148553924 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d800ba20 con 0x7f82e0068db0 2024-08-15T17:53:27.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82ddffb700 1 -- 172.21.15.105:0/3148553924 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800bde0 con 0x7f82e0068db0 2024-08-15T17:53:27.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 -- 172.21.15.105:0/3148553924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e0068db0 msgr2=0x7f82e0155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 --2- 172.21.15.105:0/3148553924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e0068db0 0x7f82e0155670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f82e01590c0 tx=0x7f82d8009840 comp rx=0 tx=0).stop 2024-08-15T17:53:27.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 -- 172.21.15.105:0/3148553924 shutdown_connections 2024-08-15T17:53:27.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 --2- 172.21.15.105:0/3148553924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e0068db0 0x7f82e0155670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 --2- 172.21.15.105:0/3148553924 >> v2:172.21.15.33:3300/0 conn(0x7f82e01552a0 0x7f82e00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 -- 172.21.15.105:0/3148553924 >> 172.21.15.105:0/3148553924 conn(0x7f82e006e350 msgr2=0x7f82e006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 -- 172.21.15.105:0/3148553924 shutdown_connections 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 -- 172.21.15.105:0/3148553924 wait complete. 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 Processor -- start 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 -- start start 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82e0068db0 0x7f82e0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.414+0000 7f82dffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e00b2370 0x7f82e00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 0x7f82e00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00c3e40 con 0x7f82e0068db0 2024-08-15T17:53:27.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00c3230 con 0x7f82e01552a0 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00c3510 con 0x7f82e00b2370 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82df7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 0x7f82e00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82df7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 0x7f82e00c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35324/0 (socket says 172.21.15.105:35324) 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82df7fe700 1 -- 172.21.15.105:0/3446824292 learned_addr learned my addr 172.21.15.105:0/3446824292 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e00b2370 0x7f82e00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82deffd700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82e0068db0 0x7f82e0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 -- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 msgr2=0x7f82e00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 0x7f82e00c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 -- 172.21.15.105:0/3446824292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82e0068db0 msgr2=0x7f82e0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82e0068db0 0x7f82e0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 -- 172.21.15.105:0/3446824292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009ae0 con 0x7f82e00b2370 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82df7fe700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 0x7f82e00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:27.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82de7fc700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e00b2370 0x7f82e00c79e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82d40011e0 tx=0x7f82d4007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011590 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4011710 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011ad0 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00c37f0 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e016a030 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f82d401c440 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f82d40129a0 con 0x7f82e00b2370 2024-08-15T17:53:27.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.418+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e0167ec0 con 0x7f82e00b2370 2024-08-15T17:53:27.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.422+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f82e0167ec0 con 0x7f82e00b2370 2024-08-15T17:53:27.494 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:27.491+0000 7f6a10e2e000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-15T17:53:27.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.518+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9a3a64f5-65b3-4388-b7de-f89a4ad2610a", "id": 5} v 0) v1 -- 0x7f82e00638f0 con 0x7f82e00b2370 2024-08-15T17:53:27.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82c6ffd700 1 -- 172.21.15.105:0/3446824292 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a3a64f5-65b3-4388-b7de-f89a4ad2610a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82d4017070 con 0x7f82e00b2370 2024-08-15T17:53:27.529 INFO:teuthology.orchestra.run.smithi105.stdout:5 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e00b2370 msgr2=0x7f82e00c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e00b2370 0x7f82e00c79e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82d40011e0 tx=0x7f82d4007d30 comp rx=0 tx=0).stop 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 shutdown_connections 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e01552a0 0x7f82e00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e00b2370 0x7f82e00c79e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 --2- 172.21.15.105:0/3446824292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82e0068db0 0x7f82e0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 >> 172.21.15.105:0/3446824292 conn(0x7f82e006e350 msgr2=0x7f82e01581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 shutdown_connections 2024-08-15T17:53:27.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.530+0000 7f82dffff700 1 -- 172.21.15.105:0/3446824292 wait complete. 2024-08-15T17:53:27.546 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 52b6fc89-f7e7-4bea-a2a6-7b0472016f73 6 2024-08-15T17:53:27.560 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:27.559+0000 7f6a10e2e000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-15T17:53:27.577 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:27.578+0000 7f2b71467000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-15T17:53:27.628 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:27.627+0000 7f6a10e2e000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-15T17:53:27.640 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:27.642+0000 7f2b71467000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-15T17:53:27.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.650+0000 7fcc255bc700 1 Processor -- start 2024-08-15T17:53:27.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.650+0000 7fcc255bc700 1 -- start start 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.650+0000 7fcc255bc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc2015dc60 0x7fcc200b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.650+0000 7fcc255bc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc200b25f0 con 0x7fcc2006ee10 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.650+0000 7fcc255bc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc200b1550 con 0x7fcc20147080 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.650+0000 7fcc255bc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200b1830 con 0x7fcc2015dc60 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc1ffff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcc20147080 0x7fcc2006e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:33424/0 (socket says 172.21.15.105:33424) 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc1ffff700 1 -- 172.21.15.105:0/2283952130 learned_addr learned my addr 172.21.15.105:0/2283952130 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-08-15T17:53:27.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc24dbb700 1 --2- 172.21.15.105:0/2283952130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc2015dc60 0x7fcc200b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc1effd700 1 -- 172.21.15.105:0/2283952130 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56763366 0 0) 0x7fcc200b1550 con 0x7fcc20147080 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc24dbb700 1 -- 172.21.15.105:0/2283952130 >> v1:172.21.15.105:6789/0 conn(0x7fcc20147080 legacy=0x7fcc2006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc24dbb700 1 -- 172.21.15.105:0/2283952130 >> v1:172.21.15.33:6789/0 conn(0x7fcc2006ee10 legacy=0x7fcc2015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc24dbb700 1 -- 172.21.15.105:0/2283952130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200b1b10 con 0x7fcc2015dc60 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc24dbb700 1 --2- 172.21.15.105:0/2283952130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc2015dc60 0x7fcc200b0e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009e90 tx=0x7fcc18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e75f549aac20d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc1effd700 1 -- 172.21.15.105:0/2283952130 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800e070 con 0x7fcc2015dc60 2024-08-15T17:53:27.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc1effd700 1 -- 172.21.15.105:0/2283952130 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800bc30 con 0x7fcc2015dc60 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc1effd700 1 -- 172.21.15.105:0/2283952130 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18012430 con 0x7fcc2015dc60 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 -- 172.21.15.105:0/2283952130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc2015dc60 msgr2=0x7fcc200b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 --2- 172.21.15.105:0/2283952130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc2015dc60 0x7fcc200b0e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009e90 tx=0x7fcc18009780 comp rx=0 tx=0).stop 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 -- 172.21.15.105:0/2283952130 shutdown_connections 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 --2- 172.21.15.105:0/2283952130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc2015dc60 0x7fcc200b0e90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 -- 172.21.15.105:0/2283952130 >> 172.21.15.105:0/2283952130 conn(0x7fcc200ca2c0 msgr2=0x7fcc2006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 -- 172.21.15.105:0/2283952130 shutdown_connections 2024-08-15T17:53:27.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.654+0000 7fcc255bc700 1 -- 172.21.15.105:0/2283952130 wait complete. 2024-08-15T17:53:27.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 Processor -- start 2024-08-15T17:53:27.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 -- start start 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 0x7fcc2016ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc20147080 0x7fcc200aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2015dc60 0x7fcc200af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2016e760 con 0x7fcc2015dc60 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2016ea40 con 0x7fcc2006ee10 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2016ed20 con 0x7fcc20147080 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 0x7fcc2016ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1f7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc20147080 0x7fcc200aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 0x7fcc2016ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35332/0 (socket says 172.21.15.105:35332) 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 -- 172.21.15.105:0/1048418500 learned_addr learned my addr 172.21.15.105:0/1048418500 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc24dbb700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2015dc60 0x7fcc200af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 -- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc20147080 msgr2=0x7fcc200aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc20147080 0x7fcc200aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 -- 172.21.15.105:0/1048418500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2015dc60 msgr2=0x7fcc200af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2015dc60 0x7fcc200af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 -- 172.21.15.105:0/1048418500 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009a20 con 0x7fcc2006ee10 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1f7fe700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc20147080 0x7fcc200aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc1ffff700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 0x7fcc2016ad40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c810 tx=0x7fcc10007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10005c00 con 0x7fcc2006ee10 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10005d60 con 0x7fcc2006ee10 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2016f000 con 0x7fcc2006ee10 2024-08-15T17:53:27.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10007320 con 0x7fcc2006ee10 2024-08-15T17:53:27.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc200a56d0 con 0x7fcc2006ee10 2024-08-15T17:53:27.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcc1001c440 con 0x7fcc2006ee10 2024-08-15T17:53:27.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.658+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fcc10007750 con 0x7fcc2006ee10 2024-08-15T17:53:27.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.662+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2016f500 con 0x7fcc2006ee10 2024-08-15T17:53:27.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.662+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fcc10017070 con 0x7fcc2006ee10 2024-08-15T17:53:27.702 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:27.702+0000 7f2b71467000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-15T17:53:27.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.734+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52b6fc89-f7e7-4bea-a2a6-7b0472016f73", "id": 6} v 0) v1 -- 0x7fcc200638f0 con 0x7fcc2006ee10 2024-08-15T17:53:27.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc07fff700 1 -- 172.21.15.105:0/1048418500 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52b6fc89-f7e7-4bea-a2a6-7b0472016f73", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc1001c920 con 0x7fcc2006ee10 2024-08-15T17:53:27.745 INFO:teuthology.orchestra.run.smithi105.stdout:6 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 msgr2=0x7fcc2016ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 0x7fcc2016ad40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c810 tx=0x7fcc10007d90 comp rx=0 tx=0).stop 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 shutdown_connections 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2015dc60 0x7fcc200af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc20147080 0x7fcc200aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 --2- 172.21.15.105:0/1048418500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc2006ee10 0x7fcc2016ad40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 >> 172.21.15.105:0/1048418500 conn(0x7fcc200ca2c0 msgr2=0x7fcc200ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 shutdown_connections 2024-08-15T17:53:27.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.746+0000 7fcc255bc700 1 -- 172.21.15.105:0/1048418500 wait complete. 2024-08-15T17:53:27.759 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 3a475085-d6a2-43b0-a2b5-cf1aaf434eea 7 2024-08-15T17:53:27.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac5e15e700 1 Processor -- start 2024-08-15T17:53:27.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac5e15e700 1 -- start start 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac5e15e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac580cc840 0x7fac580ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac5e15e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580cd150 con 0x7fac580b2210 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac5e15e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac58159ce0 con 0x7fac580b5750 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac5e15e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580af570 con 0x7fac580cc840 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac580cc840 0x7fac580ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac580cc840 0x7fac580ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35348/0 (socket says 172.21.15.105:35348) 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 -- 172.21.15.105:0/2556655323 learned_addr learned my addr 172.21.15.105:0/2556655323 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 -- 172.21.15.105:0/2556655323 >> v1:172.21.15.105:6789/0 conn(0x7fac580b5750 legacy=0x7fac5815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:27.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 -- 172.21.15.105:0/2556655323 >> v1:172.21.15.33:6789/0 conn(0x7fac580b2210 legacy=0x7fac580b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 -- 172.21.15.105:0/2556655323 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58159fc0 con 0x7fac580cc840 2024-08-15T17:53:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac577fe700 1 --2- 172.21.15.105:0/2556655323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580cc840 0x7fac580ccc10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac480099b0 tx=0x7fac48009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf38867fb32d3256 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac567fc700 1 -- 172.21.15.105:0/2556655323 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800b7e0 con 0x7fac580cc840 2024-08-15T17:53:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac567fc700 1 -- 172.21.15.105:0/2556655323 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4800b940 con 0x7fac580cc840 2024-08-15T17:53:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.858+0000 7fac567fc700 1 -- 172.21.15.105:0/2556655323 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800bce0 con 0x7fac580cc840 2024-08-15T17:53:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- 172.21.15.105:0/2556655323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580cc840 msgr2=0x7fac580ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 --2- 172.21.15.105:0/2556655323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580cc840 0x7fac580ccc10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac480099b0 tx=0x7fac48009250 comp rx=0 tx=0).stop 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- 172.21.15.105:0/2556655323 shutdown_connections 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 --2- 172.21.15.105:0/2556655323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580cc840 0x7fac580ccc10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- 172.21.15.105:0/2556655323 >> 172.21.15.105:0/2556655323 conn(0x7fac580682c0 msgr2=0x7fac580686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- 172.21.15.105:0/2556655323 shutdown_connections 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- 172.21.15.105:0/2556655323 wait complete. 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 Processor -- start 2024-08-15T17:53:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- start start 2024-08-15T17:53:27.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 0x7fac580c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580b5750 0x7fac5815ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac580cc840 0x7fac58151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c4c70 con 0x7fac580cc840 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c5440 con 0x7fac580b5750 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac5e15e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c8140 con 0x7fac580b2210 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac577fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 0x7fac580c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac56ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580b5750 0x7fac5815ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac577fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 0x7fac580c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:57702/0 (socket says 172.21.15.105:57702) 2024-08-15T17:53:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac577fe700 1 -- 172.21.15.105:0/1691840214 learned_addr learned my addr 172.21.15.105:0/1691840214 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.862+0000 7fac57fff700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac580cc840 0x7fac58151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac56ffd700 1 -- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 msgr2=0x7fac580c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac56ffd700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 0x7fac580c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac56ffd700 1 -- 172.21.15.105:0/1691840214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac580cc840 msgr2=0x7fac58151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac56ffd700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac580cc840 0x7fac58151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac56ffd700 1 -- 172.21.15.105:0/1691840214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480094f0 con 0x7fac580b5750 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac577fe700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 0x7fac580c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac56ffd700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580b5750 0x7fac5815ce80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c4e0 tx=0x7fac4c007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00ce90 con 0x7fac580b5750 2024-08-15T17:53:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c011590 con 0x7fac580b5750 2024-08-15T17:53:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011930 con 0x7fac580b5750 2024-08-15T17:53:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac580c7e10 con 0x7fac580b5750 2024-08-15T17:53:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac580c4e80 con 0x7fac580b5750 2024-08-15T17:53:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fac4c011d20 con 0x7fac580b5750 2024-08-15T17:53:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fac4c01caf0 con 0x7fac580b5750 2024-08-15T17:53:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.866+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac580c7c70 con 0x7fac580b5750 2024-08-15T17:53:27.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.870+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fac580c7c70 con 0x7fac580b5750 2024-08-15T17:53:27.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.950+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a475085-d6a2-43b0-a2b5-cf1aaf434eea", "id": 7} v 0) v1 -- 0x7fac580c82b0 con 0x7fac580b5750 2024-08-15T17:53:27.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac3f7fe700 1 -- 172.21.15.105:0/1691840214 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a475085-d6a2-43b0-a2b5-cf1aaf434eea", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac4c02b0b0 con 0x7fac580b5750 2024-08-15T17:53:27.958 INFO:teuthology.orchestra.run.smithi105.stdout:7 2024-08-15T17:53:27.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580b5750 msgr2=0x7fac5815ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580b5750 0x7fac5815ce80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c4e0 tx=0x7fac4c007ea0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 shutdown_connections 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac580b5750 0x7fac5815ce80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac580cc840 0x7fac58151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 --2- 172.21.15.105:0/1691840214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac580b2210 0x7fac580c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 >> 172.21.15.105:0/1691840214 conn(0x7fac580682c0 msgr2=0x7fac580b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 shutdown_connections 2024-08-15T17:53:27.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-08-15T17:53:27.958+0000 7fac5e15e700 1 -- 172.21.15.105:0/1691840214 wait complete. 2024-08-15T17:53:27.971 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-15T17:53:27.971 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-15T17:53:27.974 INFO:tasks.ceph.osd.0:Started 2024-08-15T17:53:27.974 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-15T17:53:27.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-15T17:53:27.977 INFO:tasks.ceph.osd.1:Started 2024-08-15T17:53:27.977 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-15T17:53:27.977 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-15T17:53:27.979 INFO:tasks.ceph.osd.2:Started 2024-08-15T17:53:27.979 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-15T17:53:27.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-15T17:53:27.982 INFO:tasks.ceph.osd.3:Started 2024-08-15T17:53:27.982 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-15T17:53:27.982 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-15T17:53:27.985 INFO:tasks.ceph.osd.4:Started 2024-08-15T17:53:27.985 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-15T17:53:27.985 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-15T17:53:27.989 INFO:tasks.ceph.osd.5:Started 2024-08-15T17:53:27.989 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-15T17:53:27.989 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-15T17:53:27.991 INFO:tasks.ceph.osd.6:Started 2024-08-15T17:53:27.991 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-15T17:53:27.991 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-15T17:53:27.993 INFO:tasks.ceph.osd.7:Started 2024-08-15T17:53:27.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:28.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 Processor -- start 2024-08-15T17:53:28.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 -- start start 2024-08-15T17:53:28.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5ba4158fb0 0x7f5ba40aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:28.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:28.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40ad380 con 0x7f5ba406e450 2024-08-15T17:53:28.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba406e8f0 con 0x7f5ba4158fb0 2024-08-15T17:53:28.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5baa029700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40ab2d0 con 0x7f5ba415d910 2024-08-15T17:53:28.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba9828700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5ba406e450 0x7f5ba40a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:35916/0 (socket says 172.21.15.33:35916) 2024-08-15T17:53:28.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba9828700 1 -- 172.21.15.33:0/1011838519 learned_addr learned my addr 172.21.15.33:0/1011838519 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:28.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba9027700 1 --2- 172.21.15.33:0/1011838519 >> v2:172.21.15.105:3300/0 conn(0x7f5ba4158fb0 0x7f5ba40aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:28.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba8826700 1 --2- 172.21.15.33:0/1011838519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:28.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5b9bfff700 1 -- 172.21.15.33:0/1011838519 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231076820 0 0) 0x7f5ba40ad380 con 0x7f5ba406e450 2024-08-15T17:53:28.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5b9bfff700 1 -- 172.21.15.33:0/1011838519 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b90003570 con 0x7f5ba406e450 2024-08-15T17:53:28.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba8826700 1 -- 172.21.15.33:0/1011838519 >> v2:172.21.15.105:3300/0 conn(0x7f5ba4158fb0 msgr2=0x7f5ba40aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:28.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba8826700 1 --2- 172.21.15.33:0/1011838519 >> v2:172.21.15.105:3300/0 conn(0x7f5ba4158fb0 0x7f5ba40aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba8826700 1 -- 172.21.15.33:0/1011838519 >> v1:172.21.15.33:6789/0 conn(0x7f5ba406e450 legacy=0x7f5ba40a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba8826700 1 -- 172.21.15.33:0/1011838519 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40ab5b0 con 0x7f5ba415d910 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba9027700 1 --2- 172.21.15.33:0/1011838519 >> v2:172.21.15.105:3300/0 conn(0x7f5ba4158fb0 0x7f5ba40aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5ba8826700 1 --2- 172.21.15.33:0/1011838519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406df10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098e0 tx=0x7f5b940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892a26a5b7f83494 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5b9bfff700 1 -- 172.21.15.33:0/1011838519 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94011630 con 0x7f5ba415d910 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5b9bfff700 1 -- 172.21.15.33:0/1011838519 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94011790 con 0x7f5ba415d910 2024-08-15T17:53:28.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f5b9bfff700 1 -- 172.21.15.33:0/1011838519 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94011b30 con 0x7f5ba415d910 2024-08-15T17:53:28.112 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.107+0000 7f6a10e2e000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-15T17:53:28.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- 172.21.15.33:0/1011838519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 msgr2=0x7f5ba406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:28.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 --2- 172.21.15.33:0/1011838519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406df10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098e0 tx=0x7f5b940091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- 172.21.15.33:0/1011838519 shutdown_connections 2024-08-15T17:53:28.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 --2- 172.21.15.33:0/1011838519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406df10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 --2- 172.21.15.33:0/1011838519 >> v2:172.21.15.105:3300/0 conn(0x7f5ba4158fb0 0x7f5ba40aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- 172.21.15.33:0/1011838519 >> 172.21.15.33:0/1011838519 conn(0x7f5ba40678d0 msgr2=0x7f5ba4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:28.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- 172.21.15.33:0/1011838519 shutdown_connections 2024-08-15T17:53:28.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- 172.21.15.33:0/1011838519 wait complete. 2024-08-15T17:53:28.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 Processor -- start 2024-08-15T17:53:28.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- start start 2024-08-15T17:53:28.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ba406e450 0x7f5ba4148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:28.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 0x7f5ba4158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:28.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:28.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40c8680 con 0x7f5ba4158fb0 2024-08-15T17:53:28.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415ddc0 con 0x7f5ba406e450 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5baa029700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415b740 con 0x7f5ba415d910 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 0x7f5ba4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 0x7f5ba4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43618/0 (socket says 172.21.15.33:43618) 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 -- 172.21.15.33:0/3012350332 learned_addr learned my addr 172.21.15.33:0/3012350332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba9828700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba9027700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ba406e450 0x7f5ba4148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 -- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 msgr2=0x7f5ba406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 -- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ba406e450 msgr2=0x7f5ba4148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ba406e450 0x7f5ba4148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 -- 172.21.15.33:0/3012350332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009a20 con 0x7f5ba4158fb0 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.111+0000 7f5ba8826700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 0x7f5ba4158110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40ab410 tx=0x7f5b94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94000d10 con 0x7f5ba4158fb0 2024-08-15T17:53:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94011b10 con 0x7f5ba4158fb0 2024-08-15T17:53:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94025640 con 0x7f5ba4158fb0 2024-08-15T17:53:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b94009420 con 0x7f5ba4158fb0 2024-08-15T17:53:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba415bd80 con 0x7f5ba4158fb0 2024-08-15T17:53:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5b94025a70 con 0x7f5ba4158fb0 2024-08-15T17:53:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.115+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5b9402ed00 con 0x7f5ba4158fb0 2024-08-15T17:53:28.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.119+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba415c100 con 0x7f5ba4158fb0 2024-08-15T17:53:28.119 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.118+0000 7f2b71467000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-15T17:53:28.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.123+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5b94033060 con 0x7f5ba4158fb0 2024-08-15T17:53:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.187+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba415df30 con 0x7f5ba4158fb0 2024-08-15T17:53:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.187+0000 7f5b997fa700 1 -- 172.21.15.33:0/3012350332 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5b94015020 con 0x7f5ba4158fb0 2024-08-15T17:53:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:28.191 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:27.952194+0000","last_up_change":"0.000000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 msgr2=0x7f5ba4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 0x7f5ba4158110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40ab410 tx=0x7f5b94017000 comp rx=0 tx=0).stop 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 shutdown_connections 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ba415d910 0x7f5ba406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba4158fb0 0x7f5ba4158110 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 --2- 172.21.15.33:0/3012350332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ba406e450 0x7f5ba4148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 >> 172.21.15.33:0/3012350332 conn(0x7f5ba40678d0 msgr2=0x7f5ba4069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 shutdown_connections 2024-08-15T17:53:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:28.191+0000 7f5baa029700 1 -- 172.21.15.33:0/3012350332 wait complete. 2024-08-15T17:53:28.203 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-15T17:53:28.203 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-15T17:53:28.231 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.230+0000 7f2b71467000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-15T17:53:28.234 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.231+0000 7f6a10e2e000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-15T17:53:28.358 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-08-15T17:53:28.358+0000 7f47563113c0 -1 Falling back to public interface 2024-08-15T17:53:28.365 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-08-15T17:53:28.366+0000 7fbde4b2d3c0 -1 Falling back to public interface 2024-08-15T17:53:28.373 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-08-15T17:53:28.371+0000 7f38ec46a3c0 -1 Falling back to public interface 2024-08-15T17:53:28.373 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-08-15T17:53:28.371+0000 7f41626353c0 -1 Falling back to public interface 2024-08-15T17:53:28.373 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-08-15T17:53:28.371+0000 7f41615fe700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2024-08-15T17:53:28.376 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-08-15T17:53:28.378+0000 7f33a64173c0 -1 Falling back to public interface 2024-08-15T17:53:28.526 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.526+0000 7f2b71467000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-15T17:53:28.557 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.555+0000 7f6a10e2e000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-15T17:53:28.601 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-08-15T17:53:28.602+0000 7fd9e0a363c0 -1 Falling back to public interface 2024-08-15T17:53:28.613 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-08-15T17:53:28.611+0000 7f15d15e03c0 -1 Falling back to public interface 2024-08-15T17:53:28.633 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-08-15T17:53:28.631+0000 7f0e9be643c0 -1 Falling back to public interface 2024-08-15T17:53:28.690 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.690+0000 7f2b71467000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-15T17:53:28.727 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.723+0000 7f6a10e2e000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-15T17:53:28.756 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.758+0000 7f2b71467000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-15T17:53:28.795 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.795+0000 7f6a10e2e000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-15T17:53:28.809 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.810+0000 7f2b71467000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-15T17:53:28.850 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.847+0000 7f6a10e2e000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-15T17:53:28.867 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:28.866+0000 7f2b71467000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-15T17:53:28.907 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:28.907+0000 7f6a10e2e000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-15T17:53:29.011 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:29.031 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:29.030+0000 7f2b71467000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-15T17:53:29.089 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:29.087+0000 7f6a10e2e000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-15T17:53:29.115 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.111+0000 7fbae5915700 1 Processor -- start 2024-08-15T17:53:29.115 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 -- start start 2024-08-15T17:53:29.117 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbae006b780 0x7fbae00aa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:29.117 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbae00aecf0 0x7fbae00af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae006b2f0 con 0x7fbae015c6d0 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00ab080 con 0x7fbae00aecf0 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00af6d0 con 0x7fbae006b780 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbae00aecf0 0x7fbae00af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbae00aecf0 0x7fbae00af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43622/0 (socket says 172.21.15.33:43622) 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 -- 172.21.15.33:0/2272765148 learned_addr learned my addr 172.21.15.33:0/2272765148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbadffff700 1 --2- 172.21.15.33:0/2272765148 >> v2:172.21.15.105:3300/0 conn(0x7fbae006b780 0x7fbae00aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 -- 172.21.15.33:0/2272765148 >> v2:172.21.15.105:3300/0 conn(0x7fbae006b780 msgr2=0x7fbae00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 --2- 172.21.15.33:0/2272765148 >> v2:172.21.15.105:3300/0 conn(0x7fbae006b780 0x7fbae00aa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 -- 172.21.15.33:0/2272765148 >> v1:172.21.15.105:6789/0 conn(0x7fbae015c6d0 legacy=0x7fbae00ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 -- 172.21.15.33:0/2272765148 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae006a6e0 con 0x7fbae00aecf0 2024-08-15T17:53:29.118 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5114700 1 --2- 172.21.15.33:0/2272765148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae00aecf0 0x7fbae00af190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbae0071110 tx=0x7fbad8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf323d0119c08a4f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbadf7fe700 1 -- 172.21.15.33:0/2272765148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800e070 con 0x7fbae00aecf0 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbadf7fe700 1 -- 172.21.15.33:0/2272765148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800ba20 con 0x7fbae00aecf0 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbadf7fe700 1 -- 172.21.15.33:0/2272765148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad80092e0 con 0x7fbae00aecf0 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 -- 172.21.15.33:0/2272765148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae00aecf0 msgr2=0x7fbae00af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.115+0000 7fbae5915700 1 --2- 172.21.15.33:0/2272765148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae00aecf0 0x7fbae00af190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbae0071110 tx=0x7fbad8009840 comp rx=0 tx=0).stop 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- 172.21.15.33:0/2272765148 shutdown_connections 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 --2- 172.21.15.33:0/2272765148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae00aecf0 0x7fbae00af190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 --2- 172.21.15.33:0/2272765148 >> v2:172.21.15.105:3300/0 conn(0x7fbae006b780 0x7fbae00aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- 172.21.15.33:0/2272765148 >> 172.21.15.33:0/2272765148 conn(0x7fbae0068630 msgr2=0x7fbae0068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- 172.21.15.33:0/2272765148 shutdown_connections 2024-08-15T17:53:29.120 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- 172.21.15.33:0/2272765148 wait complete. 2024-08-15T17:53:29.121 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 Processor -- start 2024-08-15T17:53:29.121 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- start start 2024-08-15T17:53:29.124 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 0x7fbae015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbae00aecf0 0x7fbae0153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae015c6d0 0x7fbae0158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0153650 con 0x7fbae006b780 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015b3d0 con 0x7fbae015c6d0 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae5915700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015b6b0 con 0x7fbae00aecf0 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae4913700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 0x7fbae015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae4913700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 0x7fbae015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43634/0 (socket says 172.21.15.33:43634) 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.119+0000 7fbae4913700 1 -- 172.21.15.33:0/2946624930 learned_addr learned my addr 172.21.15.33:0/2946624930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae5114700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae015c6d0 0x7fbae0158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbadffff700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbae00aecf0 0x7fbae0153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae4913700 1 -- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbae00aecf0 msgr2=0x7fbae0153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:29.125 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae4913700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbae00aecf0 0x7fbae0153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae4913700 1 -- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae015c6d0 msgr2=0x7fbae0158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae4913700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae015c6d0 0x7fbae0158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae4913700 1 -- 172.21.15.33:0/2946624930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009ae0 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae4913700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 0x7fbae015aa50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c4e0 tx=0x7fbad400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011590 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad4011710 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae0153270 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011ad0 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae0154150 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbad401c440 con 0x7fbae006b780 2024-08-15T17:53:29.126 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fbad4001020 con 0x7fbae006b780 2024-08-15T17:53:29.127 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.123+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae01530d0 con 0x7fbae006b780 2024-08-15T17:53:29.130 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.127+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbae01530d0 con 0x7fbae006b780 2024-08-15T17:53:29.195 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:29.194+0000 7f2b71467000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-15T17:53:29.198 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.195+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbae0064ba0 con 0x7fbae006b780 2024-08-15T17:53:29.199 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbadcff9700 1 -- 172.21.15.33:0/2946624930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fbad4017070 con 0x7fbae006b780 2024-08-15T17:53:29.199 INFO:teuthology.misc.health.smithi033.stdout: 2024-08-15T17:53:29.199 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:27.952194+0000","last_up_change":"0.000000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 msgr2=0x7fbae015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 0x7fbae015aa50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c4e0 tx=0x7fbad400c7f0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 shutdown_connections 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae015c6d0 0x7fbae0158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbae00aecf0 0x7fbae0153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 --2- 172.21.15.33:0/2946624930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae006b780 0x7fbae015aa50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 >> 172.21.15.33:0/2946624930 conn(0x7fbae0068630 msgr2=0x7fbae00a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:29.201 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 shutdown_connections 2024-08-15T17:53:29.202 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:29.199+0000 7fbae5915700 1 -- 172.21.15.33:0/2946624930 wait complete. 2024-08-15T17:53:29.210 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-15T17:53:29.262 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:29.262+0000 7f2b71467000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-15T17:53:29.266 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:29.263+0000 7f6a10e2e000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-15T17:53:29.331 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:29.331+0000 7f6a10e2e000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-15T17:53:29.416 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:29.418+0000 7f2b71467000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-15T17:53:29.484 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:29.486+0000 7f2b71467000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-15T17:53:29.499 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:29.495+0000 7f6a10e2e000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-15T17:53:29.563 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:29.559+0000 7f6a10e2e000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-15T17:53:30.192 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:30.194+0000 7f2b71467000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-15T17:53:30.297 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-08-15T17:53:30.295+0000 7f6a10e2e000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-15T17:53:31.240 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:31.242+0000 7f2b5a4df700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-15T17:53:31.242 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-08-15T17:53:31.242+0000 7f2b5a4df700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-15T17:53:31.913 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-08-15T17:53:31.914+0000 7f47563113c0 -1 osd.5 0 log_to_monitors true 2024-08-15T17:53:32.186 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-08-15T17:53:32.186+0000 7fbde4b2d3c0 -1 osd.7 0 log_to_monitors true 2024-08-15T17:53:32.196 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-08-15T17:53:32.195+0000 7f41626353c0 -1 osd.1 0 log_to_monitors true 2024-08-15T17:53:32.212 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-08-15T17:53:32.214+0000 7f33a64173c0 -1 osd.6 0 log_to_monitors true 2024-08-15T17:53:32.266 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-08-15T17:53:32.263+0000 7f38ec46a3c0 -1 osd.0 0 log_to_monitors true 2024-08-15T17:53:32.395 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-08-15T17:53:32.394+0000 7fd9e0a363c0 -1 osd.4 0 log_to_monitors true 2024-08-15T17:53:32.410 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-08-15T17:53:32.407+0000 7f0e9be643c0 -1 osd.2 0 log_to_monitors true 2024-08-15T17:53:32.435 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-08-15T17:53:32.435+0000 7f15d15e03c0 -1 osd.3 0 log_to_monitors true 2024-08-15T17:53:34.699 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-08-15T17:53:34.695+0000 7f415ddd5700 -1 osd.1 0 waiting for initial osdmap 2024-08-15T17:53:34.799 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-08-15T17:53:34.795+0000 7f4156b78700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:35.142 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-08-15T17:53:35.142+0000 7f33a33dc700 -1 osd.6 0 waiting for initial osdmap 2024-08-15T17:53:35.148 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-08-15T17:53:35.150+0000 7f339a95a700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:35.178 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-08-15T17:53:35.178+0000 7f4751ab1700 -1 osd.5 0 waiting for initial osdmap 2024-08-15T17:53:35.184 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-08-15T17:53:35.186+0000 7f474a854700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:35.254 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-08-15T17:53:35.254+0000 7fbde1af2700 -1 osd.7 0 waiting for initial osdmap 2024-08-15T17:53:35.261 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-08-15T17:53:35.262+0000 7fbdd9070700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:35.692 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-08-15T17:53:35.694+0000 7fd9dc1d6700 -1 osd.4 0 waiting for initial osdmap 2024-08-15T17:53:35.698 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-08-15T17:53:35.698+0000 7fd9d4f79700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:36.017 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:36.135 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 Processor -- start 2024-08-15T17:53:36.135 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 -- start start 2024-08-15T17:53:36.137 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c157ab0 0x7f437c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:36.137 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f437c0c29a0 0x7f437c161860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c1613d0 con 0x7f437c161da0 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c161130 con 0x7f437c0c29a0 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0c3180 con 0x7f437c157ab0 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437ad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f437c161da0 0x7f437c069d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:35930/0 (socket says 172.21.15.33:35930) 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437ad9d700 1 -- 172.21.15.33:0/161607059 learned_addr learned my addr 172.21.15.33:0/161607059 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437a59c700 1 --2- 172.21.15.33:0/161607059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c157ab0 0x7f437c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437959a700 1 -- 172.21.15.33:0/161607059 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345300292 0 0) 0x7f437c1613d0 con 0x7f437c161da0 2024-08-15T17:53:36.138 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437959a700 1 -- 172.21.15.33:0/161607059 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4364003570 con 0x7f437c161da0 2024-08-15T17:53:36.140 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f4379d9b700 1 --2- 172.21.15.33:0/161607059 >> v2:172.21.15.33:3300/0 conn(0x7f437c0c29a0 0x7f437c161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:36.140 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437a59c700 1 -- 172.21.15.33:0/161607059 >> v2:172.21.15.33:3300/0 conn(0x7f437c0c29a0 msgr2=0x7f437c161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:36.140 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437959a700 1 -- 172.21.15.33:0/161607059 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1397385642 0 0) 0x7f4364003570 con 0x7f437c161da0 2024-08-15T17:53:36.140 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437a59c700 1 --2- 172.21.15.33:0/161607059 >> v2:172.21.15.33:3300/0 conn(0x7f437c0c29a0 0x7f437c161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437a59c700 1 -- 172.21.15.33:0/161607059 >> v1:172.21.15.33:6789/0 conn(0x7f437c161da0 legacy=0x7f437c069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437a59c700 1 -- 172.21.15.33:0/161607059 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c0c3460 con 0x7f437c157ab0 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f4379d9b700 1 --2- 172.21.15.33:0/161607059 >> v2:172.21.15.33:3300/0 conn(0x7f437c0c29a0 0x7f437c161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437a59c700 1 --2- 172.21.15.33:0/161607059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c157ab0 0x7f437c15e700 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43700098e0 tx=0x7f43700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb2704d2f0e8d3b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437959a700 1 -- 172.21.15.33:0/161607059 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43740017f0 con 0x7f437c157ab0 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437959a700 1 -- 172.21.15.33:0/161607059 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370011420 con 0x7f437c157ab0 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.135+0000 7f437959a700 1 -- 172.21.15.33:0/161607059 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43700117a0 con 0x7f437c157ab0 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- 172.21.15.33:0/161607059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c157ab0 msgr2=0x7f437c15e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 --2- 172.21.15.33:0/161607059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c157ab0 0x7f437c15e700 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43700098e0 tx=0x7f43700091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- 172.21.15.33:0/161607059 shutdown_connections 2024-08-15T17:53:36.141 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 --2- 172.21.15.33:0/161607059 >> v2:172.21.15.33:3300/0 conn(0x7f437c0c29a0 0x7f437c161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.142 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 --2- 172.21.15.33:0/161607059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c157ab0 0x7f437c15e700 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.142 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- 172.21.15.33:0/161607059 >> 172.21.15.33:0/161607059 conn(0x7f437c0678e0 msgr2=0x7f437c067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:36.142 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- 172.21.15.33:0/161607059 shutdown_connections 2024-08-15T17:53:36.142 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- 172.21.15.33:0/161607059 wait complete. 2024-08-15T17:53:36.144 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 Processor -- start 2024-08-15T17:53:36.144 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- start start 2024-08-15T17:53:36.144 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0c29a0 0x7f437c14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c157ab0 0x7f437c157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 0x7f437c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c15c640 con 0x7f437c161da0 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c15cee0 con 0x7f437c157ab0 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c158940 con 0x7f437c0c29a0 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 0x7f437c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 0x7f437c15a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43678/0 (socket says 172.21.15.33:43678) 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437ad9d700 1 -- 172.21.15.33:0/3663390760 learned_addr learned my addr 172.21.15.33:0/3663390760 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f437a59c700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0c29a0 0x7f437c14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.139+0000 7f4379d9b700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c157ab0 0x7f437c157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437ad9d700 1 -- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0c29a0 msgr2=0x7f437c14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437ad9d700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0c29a0 0x7f437c14ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.145 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437ad9d700 1 -- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c157ab0 msgr2=0x7f437c157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437ad9d700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c157ab0 0x7f437c157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437ad9d700 1 -- 172.21.15.33:0/3663390760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370009420 con 0x7f437c161da0 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437ad9d700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 0x7f437c15a030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f437400cb90 tx=0x7f4374007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374004dc0 con 0x7f437c161da0 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400a590 con 0x7f437c161da0 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c15c890 con 0x7f437c161da0 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c15c230 con 0x7f437c161da0 2024-08-15T17:53:36.146 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400a950 con 0x7f437c161da0 2024-08-15T17:53:36.147 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f437400ad00 con 0x7f437c161da0 2024-08-15T17:53:36.147 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f436a7fc700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f435c0607d0 0x7f435c062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:36.147 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3627+0+0 (secure 0 0 0) 0x7f437407bb60 con 0x7f437c161da0 2024-08-15T17:53:36.147 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.143+0000 7f437a59c700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f435c0607d0 0x7f435c062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:36.148 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.147+0000 7f437a59c700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f435c0607d0 0x7f435c062c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f43700091e0 tx=0x7f4370016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:36.148 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.147+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43600052b0 con 0x7f437c161da0 2024-08-15T17:53:36.157 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.155+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4374018070 con 0x7f437c161da0 2024-08-15T17:53:36.186 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-08-15T17:53:36.183+0000 7f38e7c0a700 -1 osd.0 0 waiting for initial osdmap 2024-08-15T17:53:36.195 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-08-15T17:53:36.191+0000 7f38e09ad700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:36.203 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-08-15T17:53:36.199+0000 7f15ccd80700 -1 osd.3 0 waiting for initial osdmap 2024-08-15T17:53:36.208 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-08-15T17:53:36.207+0000 7f15c5b23700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:36.216 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-08-15T17:53:36.215+0000 7f0e98e29700 -1 osd.2 0 waiting for initial osdmap 2024-08-15T17:53:36.221 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-08-15T17:53:36.219+0000 7f0e903a7700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-15T17:53:36.337 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.335+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4360005560 con 0x7f437c161da0 2024-08-15T17:53:36.338 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.335+0000 7f436a7fc700 1 -- 172.21.15.33:0/3663390760 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9154 (secure 0 0 0) 0x7f437404c930 con 0x7f437c161da0 2024-08-15T17:53:36.339 INFO:teuthology.misc.health.smithi033.stdout: 2024-08-15T17:53:36.339 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":14,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:35.797284+0000","last_up_change":"2024-08-15T17:53:35.797284+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:36.341 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f435c0607d0 msgr2=0x7f435c062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:36.342 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f435c0607d0 0x7f435c062c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f43700091e0 tx=0x7f4370016000 comp rx=0 tx=0).stop 2024-08-15T17:53:36.342 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 msgr2=0x7f437c15a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:36.342 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 0x7f437c15a030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f437400cb90 tx=0x7f4374007c70 comp rx=0 tx=0).stop 2024-08-15T17:53:36.342 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 shutdown_connections 2024-08-15T17:53:36.342 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f435c0607d0 0x7f435c062c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.342 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c157ab0 0x7f437c157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.343 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437c161da0 0x7f437c15a030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.343 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 --2- 172.21.15.33:0/3663390760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0c29a0 0x7f437c14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:36.343 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 >> 172.21.15.33:0/3663390760 conn(0x7f437c0678e0 msgr2=0x7f437c0c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:36.343 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 shutdown_connections 2024-08-15T17:53:36.343 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:36.339+0000 7f437b59e700 1 -- 172.21.15.33:0/3663390760 wait complete. 2024-08-15T17:53:36.352 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-08-15T17:53:43.159 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:43.261 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc069e04700 1 Processor -- start 2024-08-15T17:53:43.261 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc069e04700 1 -- start start 2024-08-15T17:53:43.262 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc069e04700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc064159860 0x7fc0640c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.262 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc069e04700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640cba60 con 0x7fc06415a570 2024-08-15T17:53:43.262 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc069e04700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640cae50 con 0x7fc06406ea00 2024-08-15T17:53:43.263 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc069e04700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640c98f0 con 0x7fc064159860 2024-08-15T17:53:43.263 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc0637fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc06415a570 0x7fc06406e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41830/0 (socket says 172.21.15.33:41830) 2024-08-15T17:53:43.263 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc0637fe700 1 -- 172.21.15.33:0/31067050 learned_addr learned my addr 172.21.15.33:0/31067050 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:43.263 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.259+0000 7fc063fff700 1 --2- 172.21.15.33:0/31067050 >> v2:172.21.15.105:3300/0 conn(0x7fc064159860 0x7fc0640c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc0627fc700 1 -- 172.21.15.33:0/31067050 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828157201 0 0) 0x7fc0640cba60 con 0x7fc06415a570 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc0627fc700 1 -- 172.21.15.33:0/31067050 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc050003570 con 0x7fc06415a570 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc063fff700 1 -- 172.21.15.33:0/31067050 >> v1:172.21.15.105:6789/0 conn(0x7fc06406ea00 legacy=0x7fc0640c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc063fff700 1 -- 172.21.15.33:0/31067050 >> v1:172.21.15.33:6789/0 conn(0x7fc06415a570 legacy=0x7fc06406e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc063fff700 1 -- 172.21.15.33:0/31067050 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640cb130 con 0x7fc064159860 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc063fff700 1 --2- 172.21.15.33:0/31067050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc064159860 0x7fc0640c93b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e60 tx=0x7fc05c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c3cd8a70c899bf server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc0627fc700 1 -- 172.21.15.33:0/31067050 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00e070 con 0x7fc064159860 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc0627fc700 1 -- 172.21.15.33:0/31067050 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00bb60 con 0x7fc064159860 2024-08-15T17:53:43.264 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc0627fc700 1 -- 172.21.15.33:0/31067050 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c012430 con 0x7fc064159860 2024-08-15T17:53:43.265 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 -- 172.21.15.33:0/31067050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc064159860 msgr2=0x7fc0640c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.265 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 --2- 172.21.15.33:0/31067050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc064159860 0x7fc0640c93b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e60 tx=0x7fc05c009780 comp rx=0 tx=0).stop 2024-08-15T17:53:43.265 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 -- 172.21.15.33:0/31067050 shutdown_connections 2024-08-15T17:53:43.265 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 --2- 172.21.15.33:0/31067050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc064159860 0x7fc0640c93b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.266 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 -- 172.21.15.33:0/31067050 >> 172.21.15.33:0/31067050 conn(0x7fc0640700f0 msgr2=0x7fc0640704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:43.266 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 -- 172.21.15.33:0/31067050 shutdown_connections 2024-08-15T17:53:43.266 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 -- 172.21.15.33:0/31067050 wait complete. 2024-08-15T17:53:43.267 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.263+0000 7fc069e04700 1 Processor -- start 2024-08-15T17:53:43.267 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- start start 2024-08-15T17:53:43.269 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 0x7fc064156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.269 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc064159860 0x7fc06414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.269 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc06415a570 0x7fc064150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.269 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640af490 con 0x7fc06406ea00 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc064150c00 con 0x7fc06415a570 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc064150ee0 con 0x7fc064159860 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 0x7fc064156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 0x7fc064156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51708/0 (socket says 172.21.15.33:51708) 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 -- 172.21.15.33:0/1651084183 learned_addr learned my addr 172.21.15.33:0/1651084183 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc063fff700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc06415a570 0x7fc064150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc062ffd700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc064159860 0x7fc06414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 -- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc064159860 msgr2=0x7fc06414bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc064159860 0x7fc06414bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 -- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc06415a570 msgr2=0x7fc064150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc06415a570 0x7fc064150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 -- 172.21.15.33:0/1651084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009a20 con 0x7fc06406ea00 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc063fff700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc06415a570 0x7fc064150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:43.270 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc0637fe700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 0x7fc064156720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c590 tx=0x7fc054007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.271 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054005b30 con 0x7fc06406ea00 2024-08-15T17:53:43.271 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054005cb0 con 0x7fc06406ea00 2024-08-15T17:53:43.271 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640af120 con 0x7fc06406ea00 2024-08-15T17:53:43.271 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054007320 con 0x7fc06406ea00 2024-08-15T17:53:43.271 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06414c130 con 0x7fc06406ea00 2024-08-15T17:53:43.271 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.267+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064064c10 con 0x7fc06406ea00 2024-08-15T17:53:43.273 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.271+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc05401b3b0 con 0x7fc06406ea00 2024-08-15T17:53:43.273 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.271+0000 7fc05b7fe700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc044060860 0x7fc044062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.273 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.271+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc05407bd30 con 0x7fc06406ea00 2024-08-15T17:53:43.273 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.271+0000 7fc062ffd700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc044060860 0x7fc044062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.274 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.271+0000 7fc062ffd700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc044060860 0x7fc044062d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc06416d7a0 tx=0x7fc04c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.278 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.275+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc05404c430 con 0x7fc06406ea00 2024-08-15T17:53:43.447 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.443+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc064069610 con 0x7fc06406ea00 2024-08-15T17:53:43.448 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.447+0000 7fc05b7fe700 1 -- 172.21.15.33:0/1651084183 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fc05404fa50 con 0x7fc06406ea00 2024-08-15T17:53:43.449 INFO:teuthology.misc.health.smithi033.stdout: 2024-08-15T17:53:43.449 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":17,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:38.816457+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:43.451 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.447+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc044060860 msgr2=0x7fc044062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.447+0000 7fc069e04700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc044060860 0x7fc044062d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc06416d7a0 tx=0x7fc04c007ec0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 msgr2=0x7fc064156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 0x7fc064156720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c590 tx=0x7fc054007e00 comp rx=0 tx=0).stop 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 shutdown_connections 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc044060860 0x7fc044062d10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc06415a570 0x7fc064150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc064159860 0x7fc06414bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 --2- 172.21.15.33:0/1651084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc06406ea00 0x7fc064156720 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 >> 172.21.15.33:0/1651084183 conn(0x7fc0640700f0 msgr2=0x7fc064157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 shutdown_connections 2024-08-15T17:53:43.452 INFO:teuthology.misc.health.smithi033.stderr:2024-08-15T17:53:43.451+0000 7fc069e04700 1 -- 172.21.15.33:0/1651084183 wait complete. 2024-08-15T17:53:43.462 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-15T17:53:43.462 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-15T17:53:43.462 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-15T17:53:43.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-15T17:53:43.464 INFO:tasks.ceph.mds.a:Started 2024-08-15T17:53:43.464 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-15T17:53:43.464 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-15T17:53:43.466 INFO:tasks.ceph.mds.c:Started 2024-08-15T17:53:43.466 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-15T17:53:43.466 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-15T17:53:43.469 INFO:tasks.ceph.mds.b:Started 2024-08-15T17:53:43.469 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-15T17:53:43.469 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-15T17:53:43.471 INFO:tasks.ceph.mds.d:Started 2024-08-15T17:53:43.471 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-15T17:53:43.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:43.528 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-08-15T17:53:43.538 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-08-15T17:53:43.543 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-08-15T17:53:43.546 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-08-15T17:53:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.563+0000 7f9d0f555700 1 Processor -- start 2024-08-15T17:53:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.563+0000 7f9d0f555700 1 -- start start 2024-08-15T17:53:43.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d08068ca0 0x7f9d080cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d0806a470 0x7f9d0806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d080c7750 con 0x7f9d080688d0 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d080cb220 con 0x7f9d08068ca0 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080c6e20 con 0x7f9d0806a470 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d08068ca0 0x7f9d080cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d08068ca0 0x7f9d080cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51734/0 (socket says 172.21.15.33:51734) 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 -- 172.21.15.33:0/3338383047 learned_addr learned my addr 172.21.15.33:0/3338383047 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0d2f1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9d080688d0 0x7f9d080caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41852/0 (socket says 172.21.15.33:41852) 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0daf2700 1 --2- 172.21.15.33:0/3338383047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d0806a470 0x7f9d0806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 -- 172.21.15.33:0/3338383047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d0806a470 msgr2=0x7f9d0806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 --2- 172.21.15.33:0/3338383047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d0806a470 0x7f9d0806a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 -- 172.21.15.33:0/3338383047 >> v1:172.21.15.33:6789/0 conn(0x7f9d080688d0 legacy=0x7f9d080caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 -- 172.21.15.33:0/3338383047 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080c7100 con 0x7f9d08068ca0 2024-08-15T17:53:43.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9cfffff700 1 -- 172.21.15.33:0/3338383047 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232291833 0 0) 0x7f9d080c7750 con 0x7f9d080688d0 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0caf0700 1 --2- 172.21.15.33:0/3338383047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d08068ca0 0x7f9d080cc160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80099b0 tx=0x7f9cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c690ca4bfd62ba23 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9cfffff700 1 -- 172.21.15.33:0/3338383047 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800b860 con 0x7f9d08068ca0 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9cfffff700 1 -- 172.21.15.33:0/3338383047 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800b9c0 con 0x7f9d08068ca0 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9cfffff700 1 -- 172.21.15.33:0/3338383047 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800bd60 con 0x7f9d08068ca0 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- 172.21.15.33:0/3338383047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d08068ca0 msgr2=0x7f9d080cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3338383047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d08068ca0 0x7f9d080cc160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80099b0 tx=0x7f9cf8009250 comp rx=0 tx=0).stop 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- 172.21.15.33:0/3338383047 shutdown_connections 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3338383047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d0806a470 0x7f9d0806a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3338383047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d08068ca0 0x7f9d080cc160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- 172.21.15.33:0/3338383047 >> 172.21.15.33:0/3338383047 conn(0x7f9d080c9c20 msgr2=0x7f9d0806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:43.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- 172.21.15.33:0/3338383047 shutdown_connections 2024-08-15T17:53:43.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.567+0000 7f9d0f555700 1 -- 172.21.15.33:0/3338383047 wait complete. 2024-08-15T17:53:43.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 Processor -- start 2024-08-15T17:53:43.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 -- start start 2024-08-15T17:53:43.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 0x7f9d080c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08068ca0 0x7f9d081573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d0806a470 0x7f9d081698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080c5b10 con 0x7f9d080688d0 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080c4f00 con 0x7f9d0806a470 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080c51e0 con 0x7f9d08068ca0 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 0x7f9d080c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 0x7f9d080c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51740/0 (socket says 172.21.15.33:51740) 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 -- 172.21.15.33:0/3327814750 learned_addr learned my addr 172.21.15.33:0/3327814750 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0caf0700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08068ca0 0x7f9d081573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0daf2700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d0806a470 0x7f9d081698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 -- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08068ca0 msgr2=0x7f9d081573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08068ca0 0x7f9d081573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 -- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d0806a470 msgr2=0x7f9d081698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d0806a470 0x7f9d081698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 -- 172.21.15.33:0/3327814750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80094f0 con 0x7f9d080688d0 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0daf2700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d0806a470 0x7f9d081698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0d2f1700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 0x7f9d080c4870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d040011e0 tx=0x7f9d04007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04007300 con 0x7f9d080688d0 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04007460 con 0x7f9d080688d0 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d080c54c0 con 0x7f9d080688d0 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004830 con 0x7f9d080688d0 2024-08-15T17:53:43.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.571+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d08153930 con 0x7f9d080688d0 2024-08-15T17:53:43.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.575+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9d04004be0 con 0x7f9d080688d0 2024-08-15T17:53:43.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.575+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d080645c0 con 0x7f9d080688d0 2024-08-15T17:53:43.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.575+0000 7f9cfd7fa700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9cec060860 0x7f9cec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.575+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d0407bd70 con 0x7f9d080688d0 2024-08-15T17:53:43.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.575+0000 7f9d0caf0700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9cec060860 0x7f9cec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.575+0000 7f9d0caf0700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9cec060860 0x7f9cec062d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80099b0 tx=0x7f9cf8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.587+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9d0404c590 con 0x7f9d080688d0 2024-08-15T17:53:43.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.751+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d0806ea90 con 0x7f9d080688d0 2024-08-15T17:53:43.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3327814750 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f9d04018020 con 0x7f9d080688d0 2024-08-15T17:53:43.755 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:43.755 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:38.816457+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9cec060860 msgr2=0x7f9cec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9cec060860 0x7f9cec062d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80099b0 tx=0x7f9cf8017000 comp rx=0 tx=0).stop 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 msgr2=0x7f9d080c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 0x7f9d080c4870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d040011e0 tx=0x7f9d04007e10 comp rx=0 tx=0).stop 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 shutdown_connections 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9cec060860 0x7f9cec062d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d0806a470 0x7f9d081698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08068ca0 0x7f9d081573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 --2- 172.21.15.33:0/3327814750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d080688d0 0x7f9d080c4870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 >> 172.21.15.33:0/3327814750 conn(0x7f9d080c9c20 msgr2=0x7f9d080671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:43.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 shutdown_connections 2024-08-15T17:53:43.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.755+0000 7f9d0f555700 1 -- 172.21.15.33:0/3327814750 wait complete. 2024-08-15T17:53:43.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-15T17:53:43.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:53:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 Processor -- start 2024-08-15T17:53:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 -- start start 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9f440688d0 0x7f9f440aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9f44068ca0 0x7f9f44066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f44067420 con 0x7f9f44158b70 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440ab0f0 con 0x7f9f44068ca0 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.887+0000 7f9f4952e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440ab3d0 con 0x7f9f440688d0 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f437fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9f44068ca0 0x7f9f44066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f48d2d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9f44158b70 0x7f9f44158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41862/0 (socket says 172.21.15.33:41862) 2024-08-15T17:53:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f48d2d700 1 -- 172.21.15.33:0/2979191693 learned_addr learned my addr 172.21.15.33:0/2979191693 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f43fff700 1 --2- 172.21.15.33:0/2979191693 >> v2:172.21.15.105:3300/0 conn(0x7f9f440688d0 0x7f9f440aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f437fe700 1 -- 172.21.15.33:0/2979191693 >> v2:172.21.15.105:3300/0 conn(0x7f9f440688d0 msgr2=0x7f9f440aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f437fe700 1 --2- 172.21.15.33:0/2979191693 >> v2:172.21.15.105:3300/0 conn(0x7f9f440688d0 0x7f9f440aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f437fe700 1 -- 172.21.15.33:0/2979191693 >> v1:172.21.15.33:6789/0 conn(0x7f9f44158b70 legacy=0x7f9f44158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f42ffd700 1 -- 172.21.15.33:0/2979191693 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998864719 0 0) 0x7f9f44067420 con 0x7f9f44158b70 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f437fe700 1 -- 172.21.15.33:0/2979191693 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440ab6b0 con 0x7f9f44068ca0 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f437fe700 1 --2- 172.21.15.33:0/2979191693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f44068ca0 0x7f9f44066ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f44069360 tx=0x7f9f380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6411083e2425cacf server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f42ffd700 1 -- 172.21.15.33:0/2979191693 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011630 con 0x7f9f44068ca0 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f42ffd700 1 -- 172.21.15.33:0/2979191693 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38011790 con 0x7f9f44068ca0 2024-08-15T17:53:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f42ffd700 1 -- 172.21.15.33:0/2979191693 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011b30 con 0x7f9f44068ca0 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 -- 172.21.15.33:0/2979191693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f44068ca0 msgr2=0x7f9f44066ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2979191693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f44068ca0 0x7f9f44066ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f44069360 tx=0x7f9f380091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 -- 172.21.15.33:0/2979191693 shutdown_connections 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2979191693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f44068ca0 0x7f9f44066ee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2979191693 >> v2:172.21.15.105:3300/0 conn(0x7f9f440688d0 0x7f9f440aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 -- 172.21.15.33:0/2979191693 >> 172.21.15.33:0/2979191693 conn(0x7f9f4406e310 msgr2=0x7f9f4406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 -- 172.21.15.33:0/2979191693 shutdown_connections 2024-08-15T17:53:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.891+0000 7f9f4952e700 1 -- 172.21.15.33:0/2979191693 wait complete. 2024-08-15T17:53:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 Processor -- start 2024-08-15T17:53:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 -- start start 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 0x7f9f44146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44068ca0 0x7f9f44145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44158b70 0x7f9f4416c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4415e9f0 con 0x7f9f440688d0 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c1780 con 0x7f9f44068ca0 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f4952e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4416d340 con 0x7f9f44158b70 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 0x7f9f44146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 0x7f9f44146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51756/0 (socket says 172.21.15.33:51756) 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 -- 172.21.15.33:0/2135884870 learned_addr learned my addr 172.21.15.33:0/2135884870 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f437fe700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44068ca0 0x7f9f44145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f48d2d700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44158b70 0x7f9f4416c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 -- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44158b70 msgr2=0x7f9f4416c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44158b70 0x7f9f4416c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 -- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44068ca0 msgr2=0x7f9f44145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44068ca0 0x7f9f44145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f43fff700 1 -- 172.21.15.33:0/2135884870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38009420 con 0x7f9f440688d0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.895+0000 7f9f437fe700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44068ca0 0x7f9f44145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f43fff700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 0x7f9f44146880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400ecb0 tx=0x7f9f340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400c9d0 con 0x7f9f440688d0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3400cb50 con 0x7f9f440688d0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4416d620 con 0x7f9f440688d0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34013470 con 0x7f9f440688d0 2024-08-15T17:53:43.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f44146dc0 con 0x7f9f440688d0 2024-08-15T17:53:43.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9f34013860 con 0x7f9f440688d0 2024-08-15T17:53:43.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f440638f0 con 0x7f9f440688d0 2024-08-15T17:53:43.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f2bfff700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f30060860 0x7f9f30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:43.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9f3407cc90 con 0x7f9f440688d0 2024-08-15T17:53:43.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.899+0000 7f9f437fe700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f30060860 0x7f9f30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:43.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.903+0000 7f9f437fe700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f30060860 0x7f9f30062d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f380093f0 tx=0x7f9f38017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:43.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:43.903+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9f3404d410 con 0x7f9f440688d0 2024-08-15T17:53:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.067+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f44071230 con 0x7f9f440688d0 2024-08-15T17:53:44.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f2bfff700 1 -- 172.21.15.33:0/2135884870 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f340170a0 con 0x7f9f440688d0 2024-08-15T17:53:44.071 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:53:44.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f30060860 msgr2=0x7f9f30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f30060860 0x7f9f30062d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f380093f0 tx=0x7f9f38017000 comp rx=0 tx=0).stop 2024-08-15T17:53:44.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 msgr2=0x7f9f44146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 0x7f9f44146880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400ecb0 tx=0x7f9f340091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 shutdown_connections 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f30060860 0x7f9f30062d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44068ca0 0x7f9f44145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44158b70 0x7f9f4416c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 --2- 172.21.15.33:0/2135884870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f440688d0 0x7f9f44146880 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 >> 172.21.15.33:0/2135884870 conn(0x7f9f4406e310 msgr2=0x7f9f44069850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 shutdown_connections 2024-08-15T17:53:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.071+0000 7f9f4952e700 1 -- 172.21.15.33:0/2135884870 wait complete. 2024-08-15T17:53:44.085 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:53:44.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 Processor -- start 2024-08-15T17:53:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 -- start start 2024-08-15T17:53:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f857415aed0 0x7f857415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f85740cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:44.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85740ad6e0 con 0x7f85741406a0 2024-08-15T17:53:44.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85740cde50 con 0x7f857415aed0 2024-08-15T17:53:44.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857c3e6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740c86a0 con 0x7f85740ca200 2024-08-15T17:53:44.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579981700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f85740cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f857415aed0 0x7f857415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a983700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f85741406a0 0x7f85740cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:35586/0 (socket says 172.21.15.33:35586) 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f857415aed0 0x7f857415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:54708/0 (socket says 172.21.15.33:54708) 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579981700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f85740cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:54304/0 (socket says 172.21.15.33:54304) 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a983700 1 -- 172.21.15.33:0/1230546822 learned_addr learned my addr 172.21.15.33:0/1230546822 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 -- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 msgr2=0x7f85740cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 --2- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f85740cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 -- 172.21.15.33:0/1230546822 >> v1:172.21.15.105:6789/0 conn(0x7f85741406a0 legacy=0x7f85740cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 -- 172.21.15.33:0/1230546822 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85740ca6e0 con 0x7f857415aed0 2024-08-15T17:53:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579180700 1 -- 172.21.15.33:0/1230546822 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102084501 0 0) 0x7f85740ad6e0 con 0x7f85741406a0 2024-08-15T17:53:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579981700 1 --2- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f85740cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f857a182700 1 --2- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415b2a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85680098e0 tx=0x7f85680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87fe14fe5435b7f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579180700 1 -- 172.21.15.33:0/1230546822 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800b640 con 0x7f857415aed0 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579180700 1 -- 172.21.15.33:0/1230546822 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800b7a0 con 0x7f857415aed0 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.191+0000 7f8579180700 1 -- 172.21.15.33:0/1230546822 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800bb40 con 0x7f857415aed0 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 msgr2=0x7f857415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 --2- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415b2a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85680098e0 tx=0x7f85680091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- 172.21.15.33:0/1230546822 shutdown_connections 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 --2- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f85740cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 --2- 172.21.15.33:0/1230546822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415b2a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- 172.21.15.33:0/1230546822 >> 172.21.15.33:0/1230546822 conn(0x7f85740caad0 msgr2=0x7f85740caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- 172.21.15.33:0/1230546822 shutdown_connections 2024-08-15T17:53:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- 172.21.15.33:0/1230546822 wait complete. 2024-08-15T17:53:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 Processor -- start 2024-08-15T17:53:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- start start 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f857406a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 0x7f85741560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740698b0 con 0x7f85741406a0 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574068ca0 con 0x7f857415aed0 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.195+0000 7f857c3e6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8574068f80 con 0x7f85740ca200 2024-08-15T17:53:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 0x7f85741560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 0x7f85741560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51770/0 (socket says 172.21.15.33:51770) 2024-08-15T17:53:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 -- 172.21.15.33:0/815511792 learned_addr learned my addr 172.21.15.33:0/815511792 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f857a182700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f857406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f857a983700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 -- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 msgr2=0x7f857406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f857406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 -- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 msgr2=0x7f857415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 -- 172.21.15.33:0/815511792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009a20 con 0x7f85741406a0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f8579981700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 0x7f85741560c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f856400c170 tx=0x7f856400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400ccb0 con 0x7f85741406a0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400f040 con 0x7f85741406a0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564014480 con 0x7f85741406a0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8568009420 con 0x7f85741406a0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8574069540 con 0x7f85741406a0 2024-08-15T17:53:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.199+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857416a500 con 0x7f85741406a0 2024-08-15T17:53:44.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.203+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f85640147f0 con 0x7f85741406a0 2024-08-15T17:53:44.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.203+0000 7f85727fc700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8560060860 0x7f8560062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:44.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.203+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f856407d660 con 0x7f85741406a0 2024-08-15T17:53:44.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.203+0000 7f857a182700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8560060860 0x7f8560062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:44.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.203+0000 7f857a182700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8560060860 0x7f8560062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85680093f0 tx=0x7f8568017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.211+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f857416a500 con 0x7f85741406a0 2024-08-15T17:53:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.411+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f857416a500 con 0x7f85741406a0 2024-08-15T17:53:44.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f85727fc700 1 -- 172.21.15.33:0/815511792 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f857416a500 con 0x7f85741406a0 2024-08-15T17:53:44.415 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:44.415 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-15T17:53:44.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8560060860 msgr2=0x7f8560062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8560060860 0x7f8560062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85680093f0 tx=0x7f8568017000 comp rx=0 tx=0).stop 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 msgr2=0x7f85741560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 0x7f85741560c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f856400c170 tx=0x7f856400b040 comp rx=0 tx=0).stop 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 shutdown_connections 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8560060860 0x7f8560062d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f857415aed0 0x7f857415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85741406a0 0x7f85741560c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 --2- 172.21.15.33:0/815511792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85740ca200 0x7f857406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 >> 172.21.15.33:0/815511792 conn(0x7f85740caad0 msgr2=0x7f85740c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 shutdown_connections 2024-08-15T17:53:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:44.415+0000 7f857c3e6700 1 -- 172.21.15.33:0/815511792 wait complete. 2024-08-15T17:53:44.419 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-08-15T17:53:46.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:53:46.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.547+0000 7fe1e5d14700 1 Processor -- start 2024-08-15T17:53:46.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.547+0000 7fe1e5d14700 1 -- start start 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe1e0159040 0x7fe1e00cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00cf190 con 0x7fe1e00d0010 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00ce5e0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e015d9f0 con 0x7fe1e0159040 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1dffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe1e00d0010 0x7fe1e015cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41868/0 (socket says 172.21.15.33:41868) 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1dffff700 1 -- 172.21.15.33:0/1426925680 learned_addr learned my addr 172.21.15.33:0/1426925680 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e4d12700 1 --2- 172.21.15.33:0/1426925680 >> v2:172.21.15.105:3300/0 conn(0x7fe1e0159040 0x7fe1e00cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1df7fe700 1 -- 172.21.15.33:0/1426925680 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074409213 0 0) 0x7fe1e00cf190 con 0x7fe1e00d0010 2024-08-15T17:53:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1df7fe700 1 -- 172.21.15.33:0/1426925680 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1cc003570 con 0x7fe1e00d0010 2024-08-15T17:53:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e4d12700 1 -- 172.21.15.33:0/1426925680 >> v1:172.21.15.105:6789/0 conn(0x7fe1e015d5b0 legacy=0x7fe1e015aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e4d12700 1 -- 172.21.15.33:0/1426925680 >> v1:172.21.15.33:6789/0 conn(0x7fe1e00d0010 legacy=0x7fe1e015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e4d12700 1 -- 172.21.15.33:0/1426925680 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00ce860 con 0x7fe1e0159040 2024-08-15T17:53:46.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e4d12700 1 --2- 172.21.15.33:0/1426925680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e0159040 0x7fe1e00cf620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1e015db30 tx=0x7fe1d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35806dacaf3ff530 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:46.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1df7fe700 1 -- 172.21.15.33:0/1426925680 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0016070 con 0x7fe1e0159040 2024-08-15T17:53:46.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1df7fe700 1 -- 172.21.15.33:0/1426925680 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000bb60 con 0x7fe1e0159040 2024-08-15T17:53:46.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1df7fe700 1 -- 172.21.15.33:0/1426925680 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e070 con 0x7fe1e0159040 2024-08-15T17:53:46.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- 172.21.15.33:0/1426925680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e0159040 msgr2=0x7fe1e00cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/1426925680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e0159040 0x7fe1e00cf620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1e015db30 tx=0x7fe1d0009780 comp rx=0 tx=0).stop 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- 172.21.15.33:0/1426925680 shutdown_connections 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/1426925680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e0159040 0x7fe1e00cf620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- 172.21.15.33:0/1426925680 >> 172.21.15.33:0/1426925680 conn(0x7fe1e0068250 msgr2=0x7fe1e0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- 172.21.15.33:0/1426925680 shutdown_connections 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.551+0000 7fe1e5d14700 1 -- 172.21.15.33:0/1426925680 wait complete. 2024-08-15T17:53:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 Processor -- start 2024-08-15T17:53:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 -- start start 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00d0010 0x7fe1e0138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 0x7fe1e015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e015c870 0x7fe1e0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e014d8f0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0138f50 con 0x7fe1e00d0010 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e014cce0 con 0x7fe1e015c870 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 0x7fe1e015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 0x7fe1e015c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51782/0 (socket says 172.21.15.33:51782) 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 -- 172.21.15.33:0/4118768227 learned_addr learned my addr 172.21.15.33:0/4118768227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5513700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e015c870 0x7fe1e0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e4d12700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00d0010 0x7fe1e0138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 -- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e015c870 msgr2=0x7fe1e0159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e015c870 0x7fe1e0159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 -- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00d0010 msgr2=0x7fe1e0138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00d0010 0x7fe1e0138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 -- 172.21.15.33:0/4118768227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0009a20 con 0x7fe1e015d5b0 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5513700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e015c870 0x7fe1e0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e4d12700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00d0010 0x7fe1e0138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dffff700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 0x7fe1e015c330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c590 tx=0x7fe1c8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8005b30 con 0x7fe1e015d5b0 2024-08-15T17:53:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8005cb0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e014cfc0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8007320 con 0x7fe1e015d5b0 2024-08-15T17:53:46.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.555+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e014d580 con 0x7fe1e015d5b0 2024-08-15T17:53:46.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.559+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e014daa0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.559+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe1c801b3b0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.559+0000 7fe1dcff9700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe1c0060860 0x7fe1c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.559+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe1c807be60 con 0x7fe1e015d5b0 2024-08-15T17:53:46.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.559+0000 7fe1e4d12700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe1c0060860 0x7fe1c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.559+0000 7fe1e4d12700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe1c0060860 0x7fe1c0062d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0067ea0 tx=0x7fe1d0018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:46.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.563+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe1e014daa0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.763+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1e00643a0 con 0x7fe1e015d5b0 2024-08-15T17:53:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.763+0000 7fe1dcff9700 1 -- 172.21.15.33:0/4118768227 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fe1c8017020 con 0x7fe1e015d5b0 2024-08-15T17:53:46.766 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:46.766 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe1c0060860 msgr2=0x7fe1c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe1c0060860 0x7fe1c0062d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0067ea0 tx=0x7fe1d0018000 comp rx=0 tx=0).stop 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 msgr2=0x7fe1e015c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 0x7fe1e015c330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c590 tx=0x7fe1c8007e00 comp rx=0 tx=0).stop 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 shutdown_connections 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe1c0060860 0x7fe1c0062d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e015c870 0x7fe1e0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1e015d5b0 0x7fe1e015c330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 --2- 172.21.15.33:0/4118768227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00d0010 0x7fe1e0138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 >> 172.21.15.33:0/4118768227 conn(0x7fe1e0068250 msgr2=0x7fe1e00b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:46.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 shutdown_connections 2024-08-15T17:53:46.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.767+0000 7fe1e5d14700 1 -- 172.21.15.33:0/4118768227 wait complete. 2024-08-15T17:53:46.770 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2024-08-15T17:53:46.781 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 Processor -- start 2024-08-15T17:53:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 -- start start 2024-08-15T17:53:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd584140950 0x7fd5840ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd5840c97b0 0x7fd5840b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5840b0da0 con 0x7fd5840ae800 2024-08-15T17:53:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5840aec30 con 0x7fd5840c97b0 2024-08-15T17:53:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd589013700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840c9dd0 con 0x7fd584140950 2024-08-15T17:53:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd588812700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd5840c97b0 0x7fd5840b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd5837fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd5840ae800 0x7fd5840c90a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:35608/0 (socket says 172.21.15.33:35608) 2024-08-15T17:53:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd5837fe700 1 -- 172.21.15.33:0/666212674 learned_addr learned my addr 172.21.15.33:0/666212674 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd583fff700 1 --2- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd584140950 0x7fd5840ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd582ffd700 1 -- 172.21.15.33:0/666212674 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861974923 0 0) 0x7fd5840b0da0 con 0x7fd5840ae800 2024-08-15T17:53:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd582ffd700 1 -- 172.21.15.33:0/666212674 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd570003570 con 0x7fd5840ae800 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd588812700 1 -- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd584140950 msgr2=0x7fd5840ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd588812700 1 --2- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd584140950 0x7fd5840ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd588812700 1 -- 172.21.15.33:0/666212674 >> v1:172.21.15.105:6789/0 conn(0x7fd5840ae800 legacy=0x7fd5840c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd588812700 1 -- 172.21.15.33:0/666212674 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840ca0b0 con 0x7fd5840c97b0 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd588812700 1 --2- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5840c97b0 0x7fd5840b1230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd00b8f120dc2b6f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd582ffd700 1 -- 172.21.15.33:0/666212674 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c011630 con 0x7fd5840c97b0 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd582ffd700 1 -- 172.21.15.33:0/666212674 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c011790 con 0x7fd5840c97b0 2024-08-15T17:53:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.887+0000 7fd582ffd700 1 -- 172.21.15.33:0/666212674 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c011b10 con 0x7fd5840c97b0 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 -- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5840c97b0 msgr2=0x7fd5840b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 --2- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5840c97b0 0x7fd5840b1230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 -- 172.21.15.33:0/666212674 shutdown_connections 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 --2- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5840c97b0 0x7fd5840b1230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 --2- 172.21.15.33:0/666212674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd584140950 0x7fd5840ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 -- 172.21.15.33:0/666212674 >> 172.21.15.33:0/666212674 conn(0x7fd5840ca900 msgr2=0x7fd5840cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 -- 172.21.15.33:0/666212674 shutdown_connections 2024-08-15T17:53:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 -- 172.21.15.33:0/666212674 wait complete. 2024-08-15T17:53:46.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 Processor -- start 2024-08-15T17:53:46.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 -- start start 2024-08-15T17:53:46.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 0x7fd5840cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.891+0000 7fd589013700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5840c97b0 0x7fd5840c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd584140950 0x7fd58406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840b3350 con 0x7fd5840ae800 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840b2740 con 0x7fd584140950 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840b2a20 con 0x7fd5840c97b0 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd583fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 0x7fd5840cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd588812700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd584140950 0x7fd58406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd583fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 0x7fd5840cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51790/0 (socket says 172.21.15.33:51790) 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd583fff700 1 -- 172.21.15.33:0/1697413221 learned_addr learned my addr 172.21.15.33:0/1697413221 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5840c97b0 0x7fd5840c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 -- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd584140950 msgr2=0x7fd58406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd584140950 0x7fd58406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 -- 172.21.15.33:0/1697413221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 msgr2=0x7fd5840cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 0x7fd5840cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 -- 172.21.15.33:0/1697413221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009420 con 0x7fd5840c97b0 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd583fff700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 0x7fd5840cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd5837fe700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5840c97b0 0x7fd5840c76c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd57400cb90 tx=0x7fd574001980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400a7e0 con 0x7fd5840c97b0 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57400a960 con 0x7fd5840c97b0 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5840b2d00 con 0x7fd5840c97b0 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400ad20 con 0x7fd5840c97b0 2024-08-15T17:53:46.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5840cd840 con 0x7fd5840c97b0 2024-08-15T17:53:46.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.895+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5840643a0 con 0x7fd5840c97b0 2024-08-15T17:53:46.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.899+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd574007300 con 0x7fd5840c97b0 2024-08-15T17:53:46.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.899+0000 7fd57bfff700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd564060860 0x7fd564062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:46.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.899+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd57407ca50 con 0x7fd5840c97b0 2024-08-15T17:53:46.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.899+0000 7fd583fff700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd564060860 0x7fd564062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:46.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.899+0000 7fd583fff700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd564060860 0x7fd564062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009fd0 tx=0x7fd56c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:46.907+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd57404d270 con 0x7fd5840c97b0 2024-08-15T17:53:47.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.071+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5840681a0 con 0x7fd5840c97b0 2024-08-15T17:53:47.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.075+0000 7fd57bfff700 1 -- 172.21.15.33:0/1697413221 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fd574050890 con 0x7fd5840c97b0 2024-08-15T17:53:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:38.816457+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:47.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd564060860 msgr2=0x7fd564062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd564060860 0x7fd564062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009fd0 tx=0x7fd56c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5840c97b0 msgr2=0x7fd5840c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5840c97b0 0x7fd5840c76c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd57400cb90 tx=0x7fd574001980 comp rx=0 tx=0).stop 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 shutdown_connections 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd564060860 0x7fd564062d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd584140950 0x7fd58406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5840c97b0 0x7fd5840c76c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 --2- 172.21.15.33:0/1697413221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5840ae800 0x7fd5840cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 >> 172.21.15.33:0/1697413221 conn(0x7fd5840ca900 msgr2=0x7fd5840c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 shutdown_connections 2024-08-15T17:53:47.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.079+0000 7fd589013700 1 -- 172.21.15.33:0/1697413221 wait complete. 2024-08-15T17:53:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-15T17:53:47.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:53:47.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 Processor -- start 2024-08-15T17:53:47.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 -- start start 2024-08-15T17:53:47.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0934159300 0x7f09340b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09341596d0 0x7f0934066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09340cba90 con 0x7f093415dbc0 2024-08-15T17:53:47.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340b2b60 con 0x7f09341596d0 2024-08-15T17:53:47.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.207+0000 7f093c7d6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340cb160 con 0x7f0934159300 2024-08-15T17:53:47.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09341596d0 0x7f0934066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093a572700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0934159300 0x7f09340b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093ad73700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f093415dbc0 0x7f09340afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:35618/0 (socket says 172.21.15.33:35618) 2024-08-15T17:53:47.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09341596d0 0x7f0934066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:54764/0 (socket says 172.21.15.33:54764) 2024-08-15T17:53:47.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093ad73700 1 -- 172.21.15.33:0/751449996 learned_addr learned my addr 172.21.15.33:0/751449996 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:47.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093a572700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0934159300 0x7f09340b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:54344/0 (socket says 172.21.15.33:54344) 2024-08-15T17:53:47.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 -- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0934159300 msgr2=0x7f09340b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 --2- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0934159300 0x7f09340b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 -- 172.21.15.33:0/751449996 >> v1:172.21.15.105:6789/0 conn(0x7f093415dbc0 legacy=0x7f09340afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 -- 172.21.15.33:0/751449996 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340cb440 con 0x7f09341596d0 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939d71700 1 --2- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09341596d0 0x7f0934066e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09300098e0 tx=0x7f09300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d51676799721d6af server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939570700 1 -- 172.21.15.33:0/751449996 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000b640 con 0x7f09341596d0 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939570700 1 -- 172.21.15.33:0/751449996 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000b7a0 con 0x7f09341596d0 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f0939570700 1 -- 172.21.15.33:0/751449996 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000bb40 con 0x7f09341596d0 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 -- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09341596d0 msgr2=0x7f0934066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 --2- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09341596d0 0x7f0934066e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09300098e0 tx=0x7f09300091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 -- 172.21.15.33:0/751449996 shutdown_connections 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 --2- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09341596d0 0x7f0934066e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 --2- 172.21.15.33:0/751449996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0934159300 0x7f09340b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 -- 172.21.15.33:0/751449996 >> 172.21.15.33:0/751449996 conn(0x7f09340682c0 msgr2=0x7f09340686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:47.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 -- 172.21.15.33:0/751449996 shutdown_connections 2024-08-15T17:53:47.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.211+0000 7f093c7d6700 1 -- 172.21.15.33:0/751449996 wait complete. 2024-08-15T17:53:47.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 Processor -- start 2024-08-15T17:53:47.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 -- start start 2024-08-15T17:53:47.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0934159300 0x7f09340b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09341596d0 0x7f09340c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 0x7f09340b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c7940 con 0x7f093415dbc0 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c7c20 con 0x7f0934159300 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c7f00 con 0x7f09341596d0 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 0x7f09340b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 0x7f09340b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51800/0 (socket says 172.21.15.33:51800) 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 -- 172.21.15.33:0/3785072902 learned_addr learned my addr 172.21.15.33:0/3785072902 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f0939d71700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09341596d0 0x7f09340c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093a572700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0934159300 0x7f09340b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 -- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09341596d0 msgr2=0x7f09340c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09341596d0 0x7f09340c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 -- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0934159300 msgr2=0x7f09340b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0934159300 0x7f09340b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 -- 172.21.15.33:0/3785072902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930009420 con 0x7f093415dbc0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093ad73700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 0x7f09340b4200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f092c00cc70 tx=0x7f092c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00a830 con 0x7f093415dbc0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c00a9b0 con 0x7f093415dbc0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09340c81e0 con 0x7f093415dbc0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00ad70 con 0x7f093415dbc0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.215+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09340b4740 con 0x7f093415dbc0 2024-08-15T17:53:47.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.219+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09340c86e0 con 0x7f093415dbc0 2024-08-15T17:53:47.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.219+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f092c007300 con 0x7f093415dbc0 2024-08-15T17:53:47.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.219+0000 7f092a7fc700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0918060860 0x7f0918062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.219+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f092c07ca90 con 0x7f093415dbc0 2024-08-15T17:53:47.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.219+0000 7f093a572700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0918060860 0x7f0918062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.219+0000 7f093a572700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0918060860 0x7f0918062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0924009d10 tx=0x7f09240091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.227+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f092c04d2b0 con 0x7f093415dbc0 2024-08-15T17:53:47.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.391+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09340645c0 con 0x7f093415dbc0 2024-08-15T17:53:47.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.391+0000 7f092a7fc700 1 -- 172.21.15.33:0/3785072902 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f092c0508d0 con 0x7f093415dbc0 2024-08-15T17:53:47.393 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:53:47.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0918060860 msgr2=0x7f0918062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0918060860 0x7f0918062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0924009d10 tx=0x7f09240091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 msgr2=0x7f09340b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 0x7f09340b4200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f092c00cc70 tx=0x7f092c001a10 comp rx=0 tx=0).stop 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 shutdown_connections 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0918060860 0x7f0918062d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f093415dbc0 0x7f09340b4200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09341596d0 0x7f09340c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 --2- 172.21.15.33:0/3785072902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0934159300 0x7f09340b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 >> 172.21.15.33:0/3785072902 conn(0x7f09340682c0 msgr2=0x7f093414d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 shutdown_connections 2024-08-15T17:53:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.395+0000 7f093c7d6700 1 -- 172.21.15.33:0/3785072902 wait complete. 2024-08-15T17:53:47.407 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-15T17:53:47.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 Processor -- start 2024-08-15T17:53:47.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- start start 2024-08-15T17:53:47.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff84415d960 0x7ff8440aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8440b2ad0 0x7ff8440af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440ae660 con 0x7ff84415d590 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440c9f80 con 0x7ff84415d960 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440b2fd0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff84415d960 0x7ff8440aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff84415d960 0x7ff8440aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51804/0 (socket says 172.21.15.33:51804) 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 -- 172.21.15.33:0/4207195889 learned_addr learned my addr 172.21.15.33:0/4207195889 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff848fd9700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8440b2ad0 0x7ff8440af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 -- 172.21.15.33:0/4207195889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8440b2ad0 msgr2=0x7ff8440af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8440b2ad0 0x7ff8440af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 -- 172.21.15.33:0/4207195889 >> v1:172.21.15.105:6789/0 conn(0x7ff84415d590 legacy=0x7ff8440b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 -- 172.21.15.33:0/4207195889 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440c99c0 con 0x7ff84415d960 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff848fd9700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8440b2ad0 0x7ff8440af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff8437fe700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84415d960 0x7ff8440aeaf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009f20 tx=0x7ff83c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3031eef97d11dc server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff842ffd700 1 -- 172.21.15.33:0/4207195889 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00e070 con 0x7ff84415d960 2024-08-15T17:53:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff842ffd700 1 -- 172.21.15.33:0/4207195889 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00ba80 con 0x7ff84415d960 2024-08-15T17:53:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff842ffd700 1 -- 172.21.15.33:0/4207195889 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0092e0 con 0x7ff84415d960 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- 172.21.15.33:0/4207195889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84415d960 msgr2=0x7ff8440aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84415d960 0x7ff8440aeaf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009f20 tx=0x7ff83c009840 comp rx=0 tx=0).stop 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- 172.21.15.33:0/4207195889 shutdown_connections 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8440b2ad0 0x7ff8440af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/4207195889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84415d960 0x7ff8440aeaf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- 172.21.15.33:0/4207195889 >> 172.21.15.33:0/4207195889 conn(0x7ff8440a9db0 msgr2=0x7ff8440ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- 172.21.15.33:0/4207195889 shutdown_connections 2024-08-15T17:53:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.515+0000 7ff84aa3c700 1 -- 172.21.15.33:0/4207195889 wait complete. 2024-08-15T17:53:47.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 Processor -- start 2024-08-15T17:53:47.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 -- start start 2024-08-15T17:53:47.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 0x7ff8440994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff84415d590 0x7ff8440969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff84415d960 0x7ff84416de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844097240 con 0x7ff8440b2ad0 2024-08-15T17:53:47.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844097520 con 0x7ff84415d590 2024-08-15T17:53:47.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff84aa3c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844097800 con 0x7ff84415d960 2024-08-15T17:53:47.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff843fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 0x7ff8440994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff843fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 0x7ff8440994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51810/0 (socket says 172.21.15.33:51810) 2024-08-15T17:53:47.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff843fff700 1 -- 172.21.15.33:0/382682423 learned_addr learned my addr 172.21.15.33:0/382682423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:47.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff8437fe700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff84415d590 0x7ff8440969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.519+0000 7ff848fd9700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff84415d960 0x7ff84416de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff843fff700 1 -- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff84415d960 msgr2=0x7ff84416de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff843fff700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff84415d960 0x7ff84416de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff843fff700 1 -- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff84415d590 msgr2=0x7ff8440969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff843fff700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff84415d590 0x7ff8440969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff843fff700 1 -- 172.21.15.33:0/382682423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c009ae0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff843fff700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 0x7ff8440994a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c590 tx=0x7ff83800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838011590 con 0x7ff8440b2ad0 2024-08-15T17:53:47.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838011710 con 0x7ff8440b2ad0 2024-08-15T17:53:47.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff844097ae0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838011ad0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84406c140 con 0x7ff8440b2ad0 2024-08-15T17:53:47.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8440645c0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.523+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff83801b3b0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.527+0000 7ff82bfff700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff830060860 0x7ff830062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.527+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff83807bc20 con 0x7ff8440b2ad0 2024-08-15T17:53:47.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.527+0000 7ff8437fe700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff830060860 0x7ff830062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.527+0000 7ff8437fe700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff830060860 0x7ff830062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009f20 tx=0x7ff83c018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.531+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff83804c3a0 con 0x7ff8440b2ad0 2024-08-15T17:53:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.695+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff84409ae90 con 0x7ff8440b2ad0 2024-08-15T17:53:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff82bfff700 1 -- 172.21.15.33:0/382682423 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff838017020 con 0x7ff8440b2ad0 2024-08-15T17:53:47.699 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:47.699 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-08-15T17:53:47.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:53:47.700 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-08-15T17:53:47.700 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-08-15T17:53:47.700 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:53:47.700 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-08-15T17:53:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff830060860 msgr2=0x7ff830062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff830060860 0x7ff830062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009f20 tx=0x7ff83c018000 comp rx=0 tx=0).stop 2024-08-15T17:53:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 msgr2=0x7ff8440994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 0x7ff8440994a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c590 tx=0x7ff83800c8a0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 shutdown_connections 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff830060860 0x7ff830062d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff84415d590 0x7ff8440969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff84415d960 0x7ff84416de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 --2- 172.21.15.33:0/382682423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8440b2ad0 0x7ff8440994a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 >> 172.21.15.33:0/382682423 conn(0x7ff8440a9db0 msgr2=0x7ff8440b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 shutdown_connections 2024-08-15T17:53:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.699+0000 7ff84aa3c700 1 -- 172.21.15.33:0/382682423 wait complete. 2024-08-15T17:53:47.714 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-15T17:53:47.714 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-15T17:53:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 Processor -- start 2024-08-15T17:53:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 -- start start 2024-08-15T17:53:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 0x7fb4800cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb4800ceb70 0x7fb480162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cc480 con 0x7fb4800caeb0 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb480159720 con 0x7fb4800ceb70 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb487962700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cb870 con 0x7fb4800cd2b0 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb484efd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb4800caeb0 0x7fb4800ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59110/0 (socket says 172.21.15.33:59110) 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb484efd700 1 -- 172.21.15.33:0/874636588 learned_addr learned my addr 172.21.15.33:0/874636588 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 0x7fb4800cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb485eff700 1 --2- 172.21.15.33:0/874636588 >> v2:172.21.15.105:3300/0 conn(0x7fb4800ceb70 0x7fb480162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727504512 0 0) 0x7fb4800cc480 con 0x7fb4800caeb0 2024-08-15T17:53:47.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb46c003570 con 0x7fb4800caeb0 2024-08-15T17:53:47.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3457466865 0 0) 0x7fb46c003570 con 0x7fb4800caeb0 2024-08-15T17:53:47.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 msgr2=0x7fb4800cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 0x7fb4800cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 >> v2:172.21.15.105:3300/0 conn(0x7fb4800ceb70 msgr2=0x7fb480162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 --2- 172.21.15.33:0/874636588 >> v2:172.21.15.105:3300/0 conn(0x7fb4800ceb70 0x7fb480162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800cbb50 con 0x7fb4800caeb0 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fb470001470 con 0x7fb4800caeb0 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb485eff700 1 --2- 172.21.15.33:0/874636588 >> v2:172.21.15.105:3300/0 conn(0x7fb4800ceb70 0x7fb480162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 >> v1:172.21.15.33:6789/0 conn(0x7fb4800caeb0 legacy=0x7fb4800ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c003a60 0x7fb46c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb46c004810 0x7fb46c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 0x7fb46c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480159720 con 0x7fb46c003a60 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cb870 con 0x7fb46c004810 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c00ba60 con 0x7fb4800cd2b0 2024-08-15T17:53:47.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c003a60 0x7fb46c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb484efd700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb46c004810 0x7fb46c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb485eff700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 0x7fb46c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 -- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 msgr2=0x7fb46c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4800cd2b0 0x7fb46c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 -- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb46c004810 msgr2=0x7fb46c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb46c004810 0x7fb46c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.831+0000 7fb4856fe700 1 -- 172.21.15.33:0/874636588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c003570 con 0x7fb46c003a60 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb4856fe700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c003a60 0x7fb46c003e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009c30 tx=0x7fb47c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8282f80b3ecba598 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00e710 con 0x7fb46c003a60 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00e870 con 0x7fb46c003a60 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb477fff700 1 -- 172.21.15.33:0/874636588 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00ec30 con 0x7fb46c003a60 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 -- 172.21.15.33:0/874636588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c003a60 msgr2=0x7fb46c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 --2- 172.21.15.33:0/874636588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c003a60 0x7fb46c003e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009c30 tx=0x7fb47c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb485eff700 1 -- 172.21.15.33:0/874636588 reap_dead start 2024-08-15T17:53:47.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 -- 172.21.15.33:0/874636588 shutdown_connections 2024-08-15T17:53:47.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 -- 172.21.15.33:0/874636588 >> 172.21.15.33:0/874636588 conn(0x7fb480099550 msgr2=0x7fb480067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:47.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 -- 172.21.15.33:0/874636588 shutdown_connections 2024-08-15T17:53:47.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 -- 172.21.15.33:0/874636588 wait complete. 2024-08-15T17:53:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 Processor -- start 2024-08-15T17:53:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.835+0000 7fb487962700 1 -- start start 2024-08-15T17:53:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4801578d0 0x7fb4800aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 0x7fb4800af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4800b0d70 0x7fb4800b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b1aa0 con 0x7fb480157ca0 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b1d80 con 0x7fb4800b0d70 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b2060 con 0x7fb4801578d0 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 0x7fb4800af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb4856fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4801578d0 0x7fb4800aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 0x7fb4800af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38314/0 (socket says 172.21.15.33:38314) 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 -- 172.21.15.33:0/4292809022 learned_addr learned my addr 172.21.15.33:0/4292809022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb485eff700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4800b0d70 0x7fb4800b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 -- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4801578d0 msgr2=0x7fb4800aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4801578d0 0x7fb4800aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 -- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4800b0d70 msgr2=0x7fb4800b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4800b0d70 0x7fb4800b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 -- 172.21.15.33:0/4292809022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800b2340 con 0x7fb480157ca0 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb484efd700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 0x7fb4800af220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb470001050 tx=0x7fb470001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470018030 con 0x7fb480157ca0 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700077a0 con 0x7fb480157ca0 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4800b2620 con 0x7fb480157ca0 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000fa40 con 0x7fb480157ca0 2024-08-15T17:53:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800c7360 con 0x7fb480157ca0 2024-08-15T17:53:47.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.839+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4800b2810 con 0x7fb480157ca0 2024-08-15T17:53:47.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.843+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb47001b070 con 0x7fb480157ca0 2024-08-15T17:53:47.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.843+0000 7fb4757fa700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb464060860 0x7fb464062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:47.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.843+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb470019070 con 0x7fb480157ca0 2024-08-15T17:53:47.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.843+0000 7fb4856fe700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb464060860 0x7fb464062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:47.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.843+0000 7fb4856fe700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb464060860 0x7fb464062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4800afab0 tx=0x7fb47c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:47.851+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb4700508d0 con 0x7fb480157ca0 2024-08-15T17:53:48.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.015+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb4800638f0 con 0x7fb480157ca0 2024-08-15T17:53:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.871+0000 7fb4757fa700 1 -- 172.21.15.33:0/4292809022 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb470050460 con 0x7fb480157ca0 2024-08-15T17:53:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.879+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb464060860 msgr2=0x7fb464062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.879+0000 7fb487962700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb464060860 0x7fb464062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4800afab0 tx=0x7fb47c01a000 comp rx=0 tx=0).stop 2024-08-15T17:53:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.879+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 msgr2=0x7fb4800af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.879+0000 7fb487962700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 0x7fb4800af220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb470001050 tx=0x7fb470001e90 comp rx=0 tx=0).stop 2024-08-15T17:53:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 shutdown_connections 2024-08-15T17:53:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb464060860 0x7fb464062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4800b0d70 0x7fb4800b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb480157ca0 0x7fb4800af220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 --2- 172.21.15.33:0/4292809022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4801578d0 0x7fb4800aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 >> 172.21.15.33:0/4292809022 conn(0x7fb480099550 msgr2=0x7fb4800c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 shutdown_connections 2024-08-15T17:53:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:48.883+0000 7fb487962700 1 -- 172.21.15.33:0/4292809022 wait complete. 2024-08-15T17:53:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-08-15T17:53:48.896 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-15T17:53:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 Processor -- start 2024-08-15T17:53:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- start start 2024-08-15T17:53:49.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:49.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10f4158ca0 0x7f10f4159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:49.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40cfd00 con 0x7f10f40ce880 2024-08-15T17:53:49.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40cf460 con 0x7f10f4158ca0 2024-08-15T17:53:49.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40cf740 con 0x7f10f4068650 2024-08-15T17:53:49.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10f4158ca0 0x7f10f4159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:49.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f2ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f10f40ce880 0x7f10f40cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59112/0 (socket says 172.21.15.33:59112) 2024-08-15T17:53:49.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f2ffd700 1 -- 172.21.15.33:0/2214241289 learned_addr learned my addr 172.21.15.33:0/2214241289 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f37fe700 1 --2- 172.21.15.33:0/2214241289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f27fc700 1 -- 172.21.15.33:0/2214241289 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276180428 0 0) 0x7f10f40cfd00 con 0x7f10f40ce880 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f27fc700 1 -- 172.21.15.33:0/2214241289 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e0003570 con 0x7f10f40ce880 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f3fff700 1 -- 172.21.15.33:0/2214241289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 msgr2=0x7f10f4068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f3fff700 1 --2- 172.21.15.33:0/2214241289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f4068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f3fff700 1 -- 172.21.15.33:0/2214241289 >> v1:172.21.15.33:6789/0 conn(0x7f10f40ce880 legacy=0x7f10f40cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f3fff700 1 -- 172.21.15.33:0/2214241289 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40cfa20 con 0x7f10f4158ca0 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f3fff700 1 --2- 172.21.15.33:0/2214241289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f4159100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009e60 tx=0x7f10ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c88a18c2a2afda1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f27fc700 1 -- 172.21.15.33:0/2214241289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e070 con 0x7f10f4158ca0 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f27fc700 1 -- 172.21.15.33:0/2214241289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00bab0 con 0x7f10f4158ca0 2024-08-15T17:53:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10f27fc700 1 -- 172.21.15.33:0/2214241289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00be70 con 0x7f10f4158ca0 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- 172.21.15.33:0/2214241289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 msgr2=0x7f10f4159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 --2- 172.21.15.33:0/2214241289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f4159100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009e60 tx=0x7f10ec009780 comp rx=0 tx=0).stop 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- 172.21.15.33:0/2214241289 shutdown_connections 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 --2- 172.21.15.33:0/2214241289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f4159100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 --2- 172.21.15.33:0/2214241289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f4068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- 172.21.15.33:0/2214241289 >> 172.21.15.33:0/2214241289 conn(0x7f10f4066e00 msgr2=0x7f10f4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- 172.21.15.33:0/2214241289 shutdown_connections 2024-08-15T17:53:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.011+0000 7f10fa129700 1 -- 172.21.15.33:0/2214241289 wait complete. 2024-08-15T17:53:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 Processor -- start 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 -- start start 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10f40ce880 0x7f10f414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f40b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f415c0e0 con 0x7f10f4158ca0 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4150bc0 con 0x7f10f40ce880 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f41505b0 con 0x7f10f4068650 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f40b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f37fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f40b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38332/0 (socket says 172.21.15.33:38332) 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 -- 172.21.15.33:0/651017029 learned_addr learned my addr 172.21.15.33:0/651017029 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f2ffd700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10f40ce880 0x7f10f414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 -- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 msgr2=0x7f10f414ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f414ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 -- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10f40ce880 msgr2=0x7f10f414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10f40ce880 0x7f10f414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 -- 172.21.15.33:0/651017029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009a20 con 0x7f10f4158ca0 2024-08-15T17:53:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10f3fff700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f40b1f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10f4088f10 tx=0x7f10ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec012e10 con 0x7f10f4158ca0 2024-08-15T17:53:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec027470 con 0x7f10f4158ca0 2024-08-15T17:53:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f415b040 con 0x7f10f4158ca0 2024-08-15T17:53:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec027830 con 0x7f10f4158ca0 2024-08-15T17:53:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.015+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f415b320 con 0x7f10f4158ca0 2024-08-15T17:53:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.019+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f10ec024070 con 0x7f10f4158ca0 2024-08-15T17:53:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.019+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f40645c0 con 0x7f10f4158ca0 2024-08-15T17:53:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.019+0000 7f10eb7fe700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f10d4060860 0x7f10d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.019+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f10ec07f2c0 con 0x7f10f4158ca0 2024-08-15T17:53:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.019+0000 7f10f37fe700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f10d4060860 0x7f10d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.023+0000 7f10f37fe700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f10d4060860 0x7f10d4062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009db0 tx=0x7f10e40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:49.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.027+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f10ec04f8f0 con 0x7f10f4158ca0 2024-08-15T17:53:49.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.187+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f10f4150d00 con 0x7f10f4158ca0 2024-08-15T17:53:49.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.879+0000 7f10eb7fe700 1 -- 172.21.15.33:0/651017029 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f10ec052f10 con 0x7f10f4158ca0 2024-08-15T17:53:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.887+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f10d4060860 msgr2=0x7f10d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.887+0000 7f10fa129700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f10d4060860 0x7f10d4062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009db0 tx=0x7f10e40091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.887+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 msgr2=0x7f10f40b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.887+0000 7f10fa129700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f40b1f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10f4088f10 tx=0x7f10ec019000 comp rx=0 tx=0).stop 2024-08-15T17:53:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 shutdown_connections 2024-08-15T17:53:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f10d4060860 0x7f10d4062d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10f40ce880 0x7f10f414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10f4158ca0 0x7f10f40b1f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 --2- 172.21.15.33:0/651017029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10f4068650 0x7f10f414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 >> 172.21.15.33:0/651017029 conn(0x7f10f4066e00 msgr2=0x7f10f4157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 shutdown_connections 2024-08-15T17:53:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:49.903+0000 7f10fa129700 1 -- 172.21.15.33:0/651017029 wait complete. 2024-08-15T17:53:49.907 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-08-15T17:53:49.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-15T17:53:50.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.027+0000 7fe743fff700 1 Processor -- start 2024-08-15T17:53:50.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.027+0000 7fe743fff700 1 -- start start 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe7440b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe744157150 0x7fe7440cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440ca700 con 0x7fe7440cbd60 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440b21c0 con 0x7fe744157150 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b24a0 con 0x7fe744156d80 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7427fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe7440cbd60 0x7fe7440ac070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59118/0 (socket says 172.21.15.33:59118) 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7427fc700 1 -- 172.21.15.33:0/3791491614 learned_addr learned my addr 172.21.15.33:0/3791491614 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:50.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7437fe700 1 --2- 172.21.15.33:0/3791491614 >> v2:172.21.15.33:3300/0 conn(0x7fe744157150 0x7fe7440cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe742ffd700 1 --2- 172.21.15.33:0/3791491614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe7440b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe741ffb700 1 -- 172.21.15.33:0/3791491614 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153199057 0 0) 0x7fe7440ca700 con 0x7fe7440cbd60 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe741ffb700 1 -- 172.21.15.33:0/3791491614 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe72c003570 con 0x7fe7440cbd60 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7437fe700 1 -- 172.21.15.33:0/3791491614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 msgr2=0x7fe7440b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7437fe700 1 --2- 172.21.15.33:0/3791491614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe7440b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7437fe700 1 -- 172.21.15.33:0/3791491614 >> v1:172.21.15.33:6789/0 conn(0x7fe7440cbd60 legacy=0x7fe7440ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7437fe700 1 -- 172.21.15.33:0/3791491614 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440ca390 con 0x7fe744157150 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe7437fe700 1 --2- 172.21.15.33:0/3791491614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe7440cab90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009e60 tx=0x7fe73c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8272ed8904c815f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe741ffb700 1 -- 172.21.15.33:0/3791491614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00e070 con 0x7fe744157150 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe741ffb700 1 -- 172.21.15.33:0/3791491614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00bab0 con 0x7fe744157150 2024-08-15T17:53:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe741ffb700 1 -- 172.21.15.33:0/3791491614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00be70 con 0x7fe744157150 2024-08-15T17:53:50.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- 172.21.15.33:0/3791491614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 msgr2=0x7fe7440cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:50.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 --2- 172.21.15.33:0/3791491614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe7440cab90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009e60 tx=0x7fe73c009780 comp rx=0 tx=0).stop 2024-08-15T17:53:50.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- 172.21.15.33:0/3791491614 shutdown_connections 2024-08-15T17:53:50.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 --2- 172.21.15.33:0/3791491614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe7440cab90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 --2- 172.21.15.33:0/3791491614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe7440b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- 172.21.15.33:0/3791491614 >> 172.21.15.33:0/3791491614 conn(0x7fe74406e310 msgr2=0x7fe74406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- 172.21.15.33:0/3791491614 shutdown_connections 2024-08-15T17:53:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.031+0000 7fe743fff700 1 -- 172.21.15.33:0/3791491614 wait complete. 2024-08-15T17:53:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 Processor -- start 2024-08-15T17:53:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 -- start start 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7440cbd60 0x7fe744152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe74415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe74415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441592e0 con 0x7fe744157150 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441589f0 con 0x7fe7440cbd60 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe744167c20 con 0x7fe744156d80 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe74415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe74415c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38344/0 (socket says 172.21.15.33:38344) 2024-08-15T17:53:50.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 -- 172.21.15.33:0/1184109549 learned_addr learned my addr 172.21.15.33:0/1184109549 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7427fc700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe74415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7440cbd60 0x7fe744152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 -- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 msgr2=0x7fe74415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe74415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 -- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7440cbd60 msgr2=0x7fe744152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7440cbd60 0x7fe744152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 -- 172.21.15.33:0/1184109549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c009a20 con 0x7fe744157150 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7440cbd60 0x7fe744152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7427fc700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe74415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe7437fe700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe74415c8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe73c013000 tx=0x7fe73c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012ea0 con 0x7fe744157150 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c027470 con 0x7fe744157150 2024-08-15T17:53:50.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744158c90 con 0x7fe744157150 2024-08-15T17:53:50.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c027850 con 0x7fe744157150 2024-08-15T17:53:50.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.035+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe744152770 con 0x7fe744157150 2024-08-15T17:53:50.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.039+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744159490 con 0x7fe744157150 2024-08-15T17:53:50.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.039+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe73c024070 con 0x7fe744157150 2024-08-15T17:53:50.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.039+0000 7fe72affd700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe730060860 0x7fe730062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:50.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.039+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe73c07f550 con 0x7fe744157150 2024-08-15T17:53:50.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.039+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe730060860 0x7fe730062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:50.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.039+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe730060860 0x7fe730062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe734009d80 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.047+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe73c04fa00 con 0x7fe744157150 2024-08-15T17:53:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.251+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe7440638f0 con 0x7fe744157150 2024-08-15T17:53:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.915+0000 7fe72affd700 1 -- 172.21.15.33:0/1184109549 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe73c053020 con 0x7fe744157150 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe730060860 msgr2=0x7fe730062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe730060860 0x7fe730062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe734009d80 tx=0x7fe734008040 comp rx=0 tx=0).stop 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 msgr2=0x7fe74415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe74415c8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe73c013000 tx=0x7fe73c019000 comp rx=0 tx=0).stop 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 shutdown_connections 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe730060860 0x7fe730062d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe744157150 0x7fe74415c8c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe744156d80 0x7fe74415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 --2- 172.21.15.33:0/1184109549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7440cbd60 0x7fe744152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 >> 172.21.15.33:0/1184109549 conn(0x7fe74406e310 msgr2=0x7fe744155180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 shutdown_connections 2024-08-15T17:53:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:50.923+0000 7fe743fff700 1 -- 172.21.15.33:0/1184109549 wait complete. 2024-08-15T17:53:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-08-15T17:53:50.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.035+0000 7f98d3fff700 1 Processor -- start 2024-08-15T17:53:51.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.035+0000 7f98d3fff700 1 -- start start 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f98d41553e0 0x7f98d40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41557b0 0x7f98d40b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d4155c00 con 0x7f98d40686a0 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d4155e30 con 0x7f98d41553e0 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4156110 con 0x7f98d41557b0 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f98d40686a0 0x7f98d4159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59126/0 (socket says 172.21.15.33:59126) 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d37fe700 1 -- 172.21.15.33:0/3504266523 learned_addr learned my addr 172.21.15.33:0/3504266523 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98cbfff700 1 --2- 172.21.15.33:0/3504266523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41557b0 0x7f98d40b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d2ffd700 1 --2- 172.21.15.33:0/3504266523 >> v2:172.21.15.105:3300/0 conn(0x7f98d41553e0 0x7f98d40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d27fc700 1 -- 172.21.15.33:0/3504266523 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868387483 0 0) 0x7f98d4155c00 con 0x7f98d40686a0 2024-08-15T17:53:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d27fc700 1 -- 172.21.15.33:0/3504266523 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c0003570 con 0x7f98d40686a0 2024-08-15T17:53:51.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98cbfff700 1 -- 172.21.15.33:0/3504266523 >> v2:172.21.15.105:3300/0 conn(0x7f98d41553e0 msgr2=0x7f98d40af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:51.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98cbfff700 1 --2- 172.21.15.33:0/3504266523 >> v2:172.21.15.105:3300/0 conn(0x7f98d41553e0 0x7f98d40af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98cbfff700 1 -- 172.21.15.33:0/3504266523 >> v1:172.21.15.33:6789/0 conn(0x7f98d40686a0 legacy=0x7f98d4159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98cbfff700 1 -- 172.21.15.33:0/3504266523 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d41563f0 con 0x7f98d41557b0 2024-08-15T17:53:51.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d2ffd700 1 --2- 172.21.15.33:0/3504266523 >> v2:172.21.15.105:3300/0 conn(0x7f98d41553e0 0x7f98d40af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98cbfff700 1 --2- 172.21.15.33:0/3504266523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41557b0 0x7f98d40b1d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009910 tx=0x7f98bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6396b551685a8acf server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d27fc700 1 -- 172.21.15.33:0/3504266523 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00f6b0 con 0x7f98d41557b0 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d27fc700 1 -- 172.21.15.33:0/3504266523 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc00f810 con 0x7f98d41557b0 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d27fc700 1 -- 172.21.15.33:0/3504266523 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00fbb0 con 0x7f98d41557b0 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- 172.21.15.33:0/3504266523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41557b0 msgr2=0x7f98d40b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 --2- 172.21.15.33:0/3504266523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41557b0 0x7f98d40b1d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009910 tx=0x7f98bc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- 172.21.15.33:0/3504266523 shutdown_connections 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 --2- 172.21.15.33:0/3504266523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41557b0 0x7f98d40b1d70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 --2- 172.21.15.33:0/3504266523 >> v2:172.21.15.105:3300/0 conn(0x7f98d41553e0 0x7f98d40af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- 172.21.15.33:0/3504266523 >> 172.21.15.33:0/3504266523 conn(0x7f98d406d800 msgr2=0x7f98d406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- 172.21.15.33:0/3504266523 shutdown_connections 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.039+0000 7f98d3fff700 1 -- 172.21.15.33:0/3504266523 wait complete. 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 Processor -- start 2024-08-15T17:53:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 -- start start 2024-08-15T17:53:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 0x7f98d40a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41553e0 0x7f98d40ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98d41557b0 0x7f98d414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40aa7b0 con 0x7f98d40686a0 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40ae970 con 0x7f98d41557b0 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d414f600 con 0x7f98d41553e0 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 0x7f98d40a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 0x7f98d40a8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38358/0 (socket says 172.21.15.33:38358) 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 -- 172.21.15.33:0/1619671130 learned_addr learned my addr 172.21.15.33:0/1619671130 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98cbfff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41553e0 0x7f98d40ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d37fe700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98d41557b0 0x7f98d414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 -- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41553e0 msgr2=0x7f98d40ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41553e0 0x7f98d40ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 -- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98d41557b0 msgr2=0x7f98d414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98d41557b0 0x7f98d414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 -- 172.21.15.33:0/1619671130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4009420 con 0x7f98d40686a0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d2ffd700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 0x7f98d40a8400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f98c400ec80 tx=0x7f98c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400c920 con 0x7f98d40686a0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400ca80 con 0x7f98d40686a0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc009420 con 0x7f98d40686a0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400ce00 con 0x7f98d40686a0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.043+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d40a9e80 con 0x7f98d40686a0 2024-08-15T17:53:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.047+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d40638f0 con 0x7f98d40686a0 2024-08-15T17:53:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.047+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f98c4013680 con 0x7f98d40686a0 2024-08-15T17:53:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.047+0000 7f98caffd700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f98b4060890 0x7f98b4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.047+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98c407cf10 con 0x7f98d40686a0 2024-08-15T17:53:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.047+0000 7f98cbfff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f98b4060890 0x7f98b4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.047+0000 7f98cbfff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f98b4060890 0x7f98b4062d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0093f0 tx=0x7f98bc019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.059+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f98c404d360 con 0x7f98d40686a0 2024-08-15T17:53:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.219+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98d406deb0 con 0x7f98d40686a0 2024-08-15T17:53:51.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98caffd700 1 -- 172.21.15.33:0/1619671130 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f98c4017090 con 0x7f98d40686a0 2024-08-15T17:53:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:51.224 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:50.254828+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f98b4060890 msgr2=0x7f98b4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f98b4060890 0x7f98b4062d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0093f0 tx=0x7f98bc019000 comp rx=0 tx=0).stop 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 msgr2=0x7f98d40a8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 0x7f98d40a8400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f98c400ec80 tx=0x7f98c40091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 shutdown_connections 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f98b4060890 0x7f98b4062d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98d41557b0 0x7f98d414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98d41553e0 0x7f98d40ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 --2- 172.21.15.33:0/1619671130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98d40686a0 0x7f98d40a8400 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 >> 172.21.15.33:0/1619671130 conn(0x7f98d406d800 msgr2=0x7f98d40abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 shutdown_connections 2024-08-15T17:53:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.223+0000 7f98d3fff700 1 -- 172.21.15.33:0/1619671130 wait complete. 2024-08-15T17:53:51.237 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 Processor -- start 2024-08-15T17:53:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- start start 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdf881556f0 0x7fdf8813e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf8813e790 0x7fdf88156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88156940 con 0x7fdf8806aff0 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8813ec10 con 0x7fdf8813e790 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf88155d30 con 0x7fdf881556f0 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf8813e790 0x7fdf88156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8dce4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdf881556f0 0x7fdf8813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf8813e790 0x7fdf88156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38374/0 (socket says 172.21.15.33:38374) 2024-08-15T17:53:51.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 -- 172.21.15.33:0/1746215910 learned_addr learned my addr 172.21.15.33:0/1746215910 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:51.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8e4e5700 1 --1- 172.21.15.33:0/1746215910 >> v1:172.21.15.105:6789/0 conn(0x7fdf8806aff0 0x7fdf880b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:40342/0 (socket says 172.21.15.33:40342) 2024-08-15T17:53:51.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 -- 172.21.15.33:0/1746215910 >> v2:172.21.15.105:3300/0 conn(0x7fdf881556f0 msgr2=0x7fdf8813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:51.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 --2- 172.21.15.33:0/1746215910 >> v2:172.21.15.105:3300/0 conn(0x7fdf881556f0 0x7fdf8813e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 -- 172.21.15.33:0/1746215910 >> v1:172.21.15.105:6789/0 conn(0x7fdf8806aff0 legacy=0x7fdf880b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 -- 172.21.15.33:0/1746215910 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88156010 con 0x7fdf8813e790 2024-08-15T17:53:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8ece6700 1 --2- 172.21.15.33:0/1746215910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8813e790 0x7fdf88156dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf8806c630 tx=0x7fdf80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3d18d26d5d42f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8d4e3700 1 -- 172.21.15.33:0/1746215910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000e070 con 0x7fdf8813e790 2024-08-15T17:53:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8d4e3700 1 -- 172.21.15.33:0/1746215910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000ba20 con 0x7fdf8813e790 2024-08-15T17:53:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8d4e3700 1 -- 172.21.15.33:0/1746215910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800092e0 con 0x7fdf8813e790 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/1746215910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8813e790 msgr2=0x7fdf88156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/1746215910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8813e790 0x7fdf88156dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf8806c630 tx=0x7fdf80009840 comp rx=0 tx=0).stop 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/1746215910 shutdown_connections 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/1746215910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8813e790 0x7fdf88156dd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/1746215910 >> v2:172.21.15.105:3300/0 conn(0x7fdf881556f0 0x7fdf8813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/1746215910 >> 172.21.15.33:0/1746215910 conn(0x7fdf880678d0 msgr2=0x7fdf88067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/1746215910 shutdown_connections 2024-08-15T17:53:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.347+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/1746215910 wait complete. 2024-08-15T17:53:51.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 Processor -- start 2024-08-15T17:53:51.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 -- start start 2024-08-15T17:53:51.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8806aff0 0x7fdf88134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 0x7fdf8813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf881556f0 0x7fdf8813cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88151150 con 0x7fdf8806aff0 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881531f0 con 0x7fdf8813e790 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8f4e7700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88133cb0 con 0x7fdf881556f0 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8e4e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8806aff0 0x7fdf88134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8dce4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 0x7fdf8813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8dce4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 0x7fdf8813ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:47466/0 (socket says 172.21.15.33:47466) 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8dce4700 1 -- 172.21.15.33:0/66200861 learned_addr learned my addr 172.21.15.33:0/66200861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8e4e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8806aff0 0x7fdf88134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38380/0 (socket says 172.21.15.33:38380) 2024-08-15T17:53:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.351+0000 7fdf8ece6700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf881556f0 0x7fdf8813cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8dce4700 1 -- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf881556f0 msgr2=0x7fdf8813cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8dce4700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf881556f0 0x7fdf8813cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8dce4700 1 -- 172.21.15.33:0/66200861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8806aff0 msgr2=0x7fdf88134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8dce4700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8806aff0 0x7fdf88134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8dce4700 1 -- 172.21.15.33:0/66200861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009ae0 con 0x7fdf8813e790 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8dce4700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 0x7fdf8813ca50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400e960 tx=0x7fdf840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84013680 con 0x7fdf8813e790 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840137e0 con 0x7fdf8813e790 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf881330a0 con 0x7fdf8813e790 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84013b80 con 0x7fdf8813e790 2024-08-15T17:53:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf88133660 con 0x7fdf8813e790 2024-08-15T17:53:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf88133e20 con 0x7fdf8813e790 2024-08-15T17:53:51.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.355+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdf840123d0 con 0x7fdf8813e790 2024-08-15T17:53:51.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.359+0000 7fdf7e7fc700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf6c060860 0x7fdf6c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.359+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf8407cc20 con 0x7fdf8813e790 2024-08-15T17:53:51.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.359+0000 7fdf8e4e5700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf6c060860 0x7fdf6c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.359+0000 7fdf8e4e5700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf6c060860 0x7fdf6c062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf78007fd0 tx=0x7fdf78007f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.371+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdf8404d070 con 0x7fdf8813e790 2024-08-15T17:53:51.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.527+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf880643a0 con 0x7fdf8813e790 2024-08-15T17:53:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.531+0000 7fdf7e7fc700 1 -- 172.21.15.33:0/66200861 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fdf84050690 con 0x7fdf8813e790 2024-08-15T17:53:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:51.533 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:50.254828+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.531+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf6c060860 msgr2=0x7fdf6c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.531+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf6c060860 0x7fdf6c062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf78007fd0 tx=0x7fdf78007f40 comp rx=0 tx=0).stop 2024-08-15T17:53:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 msgr2=0x7fdf8813ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 0x7fdf8813ca50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400e960 tx=0x7fdf840091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 shutdown_connections 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf6c060860 0x7fdf6c062d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8813e790 0x7fdf8813ca50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf881556f0 0x7fdf8813cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 --2- 172.21.15.33:0/66200861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf8806aff0 0x7fdf88134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 >> 172.21.15.33:0/66200861 conn(0x7fdf880678d0 msgr2=0x7fdf88063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 shutdown_connections 2024-08-15T17:53:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.535+0000 7fdf8f4e7700 1 -- 172.21.15.33:0/66200861 wait complete. 2024-08-15T17:53:51.547 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-15T17:53:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.655+0000 7fbbcffff700 1 Processor -- start 2024-08-15T17:53:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.655+0000 7fbbcffff700 1 -- start start 2024-08-15T17:53:51.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbbd01574f0 0x7fbbd0157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd00b0d90 0x7fbbd00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd006e010 con 0x7fbbd01514d0 2024-08-15T17:53:51.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00b1750 con 0x7fbbd01574f0 2024-08-15T17:53:51.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0157fb0 con 0x7fbbd00b0d90 2024-08-15T17:53:51.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbbd01574f0 0x7fbbd0157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcf7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd00b0d90 0x7fbbd00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbbd01574f0 0x7fbbd0157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:47472/0 (socket says 172.21.15.33:47472) 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 -- 172.21.15.33:0/1779840210 learned_addr learned my addr 172.21.15.33:0/1779840210 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbceffd700 1 --1- 172.21.15.33:0/1779840210 >> v1:172.21.15.105:6789/0 conn(0x7fbbd01514d0 0x7fbbd006ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:40344/0 (socket says 172.21.15.33:40344) 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 -- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd00b0d90 msgr2=0x7fbbd00b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 --2- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd00b0d90 0x7fbbd00b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 -- 172.21.15.33:0/1779840210 >> v1:172.21.15.105:6789/0 conn(0x7fbbd01514d0 legacy=0x7fbbd006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 -- 172.21.15.33:0/1779840210 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0158290 con 0x7fbbd01574f0 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbce7fc700 1 --2- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd01574f0 0x7fbbd0157970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40099b0 tx=0x7fbbc4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70614a0fc5075425 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcdffb700 1 -- 172.21.15.33:0/1779840210 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4009ea0 con 0x7fbbd01574f0 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcdffb700 1 -- 172.21.15.33:0/1779840210 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400b860 con 0x7fbbd01574f0 2024-08-15T17:53:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcdffb700 1 -- 172.21.15.33:0/1779840210 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400bc00 con 0x7fbbd01574f0 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd01574f0 msgr2=0x7fbbd0157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 --2- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd01574f0 0x7fbbd0157970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40099b0 tx=0x7fbbc4009250 comp rx=0 tx=0).stop 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- 172.21.15.33:0/1779840210 shutdown_connections 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 --2- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd00b0d90 0x7fbbd00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 --2- 172.21.15.33:0/1779840210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd01574f0 0x7fbbd0157970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- 172.21.15.33:0/1779840210 >> 172.21.15.33:0/1779840210 conn(0x7fbbd00678a0 msgr2=0x7fbbd0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- 172.21.15.33:0/1779840210 shutdown_connections 2024-08-15T17:53:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.659+0000 7fbbcffff700 1 -- 172.21.15.33:0/1779840210 wait complete. 2024-08-15T17:53:51.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 Processor -- start 2024-08-15T17:53:51.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 -- start start 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd00b0d90 0x7fbbd0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 0x7fbbd00a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd01574f0 0x7fbbd01453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01533b0 con 0x7fbbd01514d0 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00a5f10 con 0x7fbbd00b0d90 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00a61f0 con 0x7fbbd01574f0 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbce7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 0x7fbbd00a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbce7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 0x7fbbd00a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38396/0 (socket says 172.21.15.33:38396) 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbce7fc700 1 -- 172.21.15.33:0/2289023514 learned_addr learned my addr 172.21.15.33:0/2289023514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbceffd700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd00b0d90 0x7fbbd0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.663+0000 7fbbcf7fe700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd01574f0 0x7fbbd01453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbce7fc700 1 -- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd01574f0 msgr2=0x7fbbd01453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbce7fc700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd01574f0 0x7fbbd01453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbce7fc700 1 -- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd00b0d90 msgr2=0x7fbbd0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbce7fc700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd00b0d90 0x7fbbd0156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbce7fc700 1 -- 172.21.15.33:0/2289023514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40094f0 con 0x7fbbd01514d0 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbce7fc700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 0x7fbbd00a5450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006fbb0 tx=0x7fbbc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4000d10 con 0x7fbbd01514d0 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400bbe0 con 0x7fbbd01514d0 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd00a64d0 con 0x7fbbd01514d0 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc401a6a0 con 0x7fbbd01514d0 2024-08-15T17:53:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd014fc20 con 0x7fbbd01514d0 2024-08-15T17:53:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd0064330 con 0x7fbbd01514d0 2024-08-15T17:53:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.667+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbbc401aa10 con 0x7fbbd01514d0 2024-08-15T17:53:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.671+0000 7fbbb6ffd700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.671+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbc407e3f0 con 0x7fbbd01514d0 2024-08-15T17:53:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.671+0000 7fbbceffd700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.671+0000 7fbbceffd700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00c7e80 tx=0x7fbbc0007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.675+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbbc404e840 con 0x7fbbd01514d0 2024-08-15T17:53:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.871+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbbd00c89e0 con 0x7fbbd01514d0 2024-08-15T17:53:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.911+0000 7fbbb6ffd700 1 -- 172.21.15.33:0/2289023514 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbbc4051e60 con 0x7fbbd01514d0 2024-08-15T17:53:51.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 msgr2=0x7fbbbc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00c7e80 tx=0x7fbbc0007eb0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 msgr2=0x7fbbd00a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:51.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 0x7fbbd00a5450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006fbb0 tx=0x7fbbc4017000 comp rx=0 tx=0).stop 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 shutdown_connections 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd01574f0 0x7fbbd01453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd01514d0 0x7fbbd00a5450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 --2- 172.21.15.33:0/2289023514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd00b0d90 0x7fbbd0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 >> 172.21.15.33:0/2289023514 conn(0x7fbbd00678a0 msgr2=0x7fbbd0159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 shutdown_connections 2024-08-15T17:53:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:51.915+0000 7fbbcffff700 1 -- 172.21.15.33:0/2289023514 wait complete. 2024-08-15T17:53:51.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-15T17:53:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.039+0000 7fab094bc700 1 Processor -- start 2024-08-15T17:53:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.039+0000 7fab094bc700 1 -- start start 2024-08-15T17:53:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab094bc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 0x7fab040b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab094bc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab0406bac0 0x7fab040686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab094bc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040adb00 con 0x7fab041597d0 2024-08-15T17:53:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab094bc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0406bf60 con 0x7fab04159400 2024-08-15T17:53:52.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab094bc700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab040ac630 con 0x7fab0406bac0 2024-08-15T17:53:52.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab02ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 0x7fab040b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:52.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab02ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 0x7fab040b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38398/0 (socket says 172.21.15.33:38398) 2024-08-15T17:53:52.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab037fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab0406bac0 0x7fab040686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:52.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab02ffd700 1 -- 172.21.15.33:0/918182986 learned_addr learned my addr 172.21.15.33:0/918182986 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:52.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7faafbfff700 1 --1- 172.21.15.33:0/918182986 >> v1:172.21.15.105:6789/0 conn(0x7fab041597d0 0x7fab040ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:40350/0 (socket says 172.21.15.33:40350) 2024-08-15T17:53:52.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab027fc700 1 -- 172.21.15.33:0/918182986 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337859109 0 0) 0x7fab040adb00 con 0x7fab041597d0 2024-08-15T17:53:52.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab027fc700 1 -- 172.21.15.33:0/918182986 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae4003570 con 0x7fab041597d0 2024-08-15T17:53:52.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab037fe700 1 -- 172.21.15.33:0/918182986 >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 msgr2=0x7fab040b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:52.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab037fe700 1 --2- 172.21.15.33:0/918182986 >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 0x7fab040b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab037fe700 1 -- 172.21.15.33:0/918182986 >> v1:172.21.15.105:6789/0 conn(0x7fab041597d0 legacy=0x7fab040ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab037fe700 1 -- 172.21.15.33:0/918182986 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040ac910 con 0x7fab0406bac0 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab02ffd700 1 --2- 172.21.15.33:0/918182986 >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 0x7fab040b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab037fe700 1 --2- 172.21.15.33:0/918182986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040686a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab040710b0 tx=0x7faafc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f440ce1544345f65 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab027fc700 1 -- 172.21.15.33:0/918182986 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00e070 con 0x7fab0406bac0 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab027fc700 1 -- 172.21.15.33:0/918182986 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc00bab0 con 0x7fab0406bac0 2024-08-15T17:53:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.043+0000 7fab027fc700 1 -- 172.21.15.33:0/918182986 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00be70 con 0x7fab0406bac0 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 -- 172.21.15.33:0/918182986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 msgr2=0x7fab040686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 --2- 172.21.15.33:0/918182986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040686a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab040710b0 tx=0x7faafc009780 comp rx=0 tx=0).stop 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 -- 172.21.15.33:0/918182986 shutdown_connections 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 --2- 172.21.15.33:0/918182986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040686a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 --2- 172.21.15.33:0/918182986 >> v2:172.21.15.33:3300/0 conn(0x7fab04159400 0x7fab040b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 -- 172.21.15.33:0/918182986 >> 172.21.15.33:0/918182986 conn(0x7fab040c9bf0 msgr2=0x7fab0406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 -- 172.21.15.33:0/918182986 shutdown_connections 2024-08-15T17:53:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 -- 172.21.15.33:0/918182986 wait complete. 2024-08-15T17:53:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 Processor -- start 2024-08-15T17:53:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.047+0000 7fab094bc700 1 -- start start 2024-08-15T17:53:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 0x7fab040cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab041597d0 0x7fab04155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040cb790 con 0x7fab04159400 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040cba60 con 0x7fab0406bac0 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab040cbd40 con 0x7fab041597d0 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 0x7fab040cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 0x7fab040cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38412/0 (socket says 172.21.15.33:38412) 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 -- 172.21.15.33:0/3133859483 learned_addr learned my addr 172.21.15.33:0/3133859483 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab02ffd700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab037fe700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab041597d0 0x7fab04155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 -- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab041597d0 msgr2=0x7fab04155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab041597d0 0x7fab04155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 -- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 msgr2=0x7fab040cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 -- 172.21.15.33:0/3133859483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40094f0 con 0x7fab04159400 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab037fe700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab041597d0 0x7fab04155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafbfff700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 0x7fab040cb250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c590 tx=0x7faaec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec005c10 con 0x7fab04159400 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec005d90 con 0x7fab04159400 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc009a20 con 0x7fab04159400 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec007320 con 0x7fab04159400 2024-08-15T17:53:52.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.051+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab040cc300 con 0x7fab04159400 2024-08-15T17:53:52.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.055+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab040cc520 con 0x7fab04159400 2024-08-15T17:53:52.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.055+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faaec01b3b0 con 0x7fab04159400 2024-08-15T17:53:52.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.055+0000 7faafaffd700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7faae8060860 0x7faae8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:52.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.055+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faaec07c320 con 0x7fab04159400 2024-08-15T17:53:52.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.055+0000 7fab02ffd700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7faae8060860 0x7faae8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:52.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.055+0000 7fab02ffd700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7faae8060860 0x7faae8062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faaf4006d20 tx=0x7faaf4009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:52.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.059+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faaec04c6d0 con 0x7fab04159400 2024-08-15T17:53:52.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.259+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab040645c0 con 0x7fab04159400 2024-08-15T17:53:52.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.919+0000 7faafaffd700 1 -- 172.21.15.33:0/3133859483 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7faaec04fcf0 con 0x7fab04159400 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7faae8060860 msgr2=0x7faae8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7faae8060860 0x7faae8062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faaf4006d20 tx=0x7faaf4009250 comp rx=0 tx=0).stop 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 msgr2=0x7fab040cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 0x7fab040cb250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c590 tx=0x7faaec007e00 comp rx=0 tx=0).stop 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 shutdown_connections 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7faae8060860 0x7faae8062d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab041597d0 0x7fab04155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab04159400 0x7fab040cb250 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 --2- 172.21.15.33:0/3133859483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0406bac0 0x7fab040cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 >> 172.21.15.33:0/3133859483 conn(0x7fab040c9bf0 msgr2=0x7fab0406d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 shutdown_connections 2024-08-15T17:53:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:52.927+0000 7fab094bc700 1 -- 172.21.15.33:0/3133859483 wait complete. 2024-08-15T17:53:52.943 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:53:53.030 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:53:53.032 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:53:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 Processor -- start 2024-08-15T17:53:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 -- start start 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ad40b3b30 0x7f6ad40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad40b4490 con 0x7f6ad415a2e0 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad415bc90 con 0x7f6ad40b3b30 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ada66a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad415b010 con 0x7f6ad40aac50 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ad415a2e0 0x7f6ad41574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59132/0 (socket says 172.21.15.33:59132) 2024-08-15T17:53:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad37fe700 1 -- 172.21.15.33:0/3028355297 learned_addr learned my addr 172.21.15.33:0/3028355297 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad8c07700 1 --2- 172.21.15.33:0/3028355297 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40b3b30 0x7f6ad40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad3fff700 1 --2- 172.21.15.33:0/3028355297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad2ffd700 1 -- 172.21.15.33:0/3028355297 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436673500 0 0) 0x7f6ad40b4490 con 0x7f6ad415a2e0 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad2ffd700 1 -- 172.21.15.33:0/3028355297 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6abc003570 con 0x7f6ad415a2e0 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad3fff700 1 -- 172.21.15.33:0/3028355297 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40b3b30 msgr2=0x7f6ad40b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad2ffd700 1 -- 172.21.15.33:0/3028355297 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165126363 0 0) 0x7f6abc003570 con 0x7f6ad415a2e0 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.051+0000 7f6ad3fff700 1 --2- 172.21.15.33:0/3028355297 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40b3b30 0x7f6ad40b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ad3fff700 1 -- 172.21.15.33:0/3028355297 >> v1:172.21.15.33:6789/0 conn(0x7f6ad415a2e0 legacy=0x7f6ad41574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ad3fff700 1 -- 172.21.15.33:0/3028355297 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad415b2f0 con 0x7f6ad40aac50 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ad3fff700 1 --2- 172.21.15.33:0/3028355297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad415aa30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80098d0 tx=0x7f6ac8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d880fdee97475e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ad2ffd700 1 -- 172.21.15.33:0/3028355297 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4001470 con 0x7f6ad40aac50 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ad2ffd700 1 -- 172.21.15.33:0/3028355297 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac8011420 con 0x7f6ad40aac50 2024-08-15T17:53:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ad2ffd700 1 -- 172.21.15.33:0/3028355297 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80117e0 con 0x7f6ad40aac50 2024-08-15T17:53:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 -- 172.21.15.33:0/3028355297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 msgr2=0x7f6ad415aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 --2- 172.21.15.33:0/3028355297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad415aa30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80098d0 tx=0x7f6ac8009120 comp rx=0 tx=0).stop 2024-08-15T17:53:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 -- 172.21.15.33:0/3028355297 shutdown_connections 2024-08-15T17:53:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 --2- 172.21.15.33:0/3028355297 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40b3b30 0x7f6ad40b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 --2- 172.21.15.33:0/3028355297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad415aa30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 -- 172.21.15.33:0/3028355297 >> 172.21.15.33:0/3028355297 conn(0x7f6ad40994d0 msgr2=0x7f6ad40675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 -- 172.21.15.33:0/3028355297 shutdown_connections 2024-08-15T17:53:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 -- 172.21.15.33:0/3028355297 wait complete. 2024-08-15T17:53:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 Processor -- start 2024-08-15T17:53:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.055+0000 7f6ada66a700 1 -- start start 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad4169020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad40b3b30 0x7f6ad40ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad415a2e0 0x7f6ad41457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40ac7b0 con 0x7f6ad40b3b30 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4145d20 con 0x7f6ad415a2e0 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40abba0 con 0x7f6ad40aac50 2024-08-15T17:53:53.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad40b3b30 0x7f6ad40ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad40b3b30 0x7f6ad40ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38422/0 (socket says 172.21.15.33:38422) 2024-08-15T17:53:53.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad4169020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad37fe700 1 -- 172.21.15.33:0/4055091779 learned_addr learned my addr 172.21.15.33:0/4055091779 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:53.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad8c07700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad415a2e0 0x7f6ad41457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 -- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad415a2e0 msgr2=0x7f6ad41457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad415a2e0 0x7f6ad41457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 -- 172.21.15.33:0/4055091779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad40b3b30 msgr2=0x7f6ad40ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad40b3b30 0x7f6ad40ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 -- 172.21.15.33:0/4055091779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80093c0 con 0x7f6ad40aac50 2024-08-15T17:53:53.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ad3fff700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad4169020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8015000 tx=0x7f6ac8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac801caf0 con 0x7f6ad40aac50 2024-08-15T17:53:53.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac801cc50 con 0x7f6ad40aac50 2024-08-15T17:53:53.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad40abe80 con 0x7f6ad40aac50 2024-08-15T17:53:53.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac801a450 con 0x7f6ad40aac50 2024-08-15T17:53:53.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad40ac440 con 0x7f6ad40aac50 2024-08-15T17:53:53.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.059+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad40ab300 con 0x7f6ad40aac50 2024-08-15T17:53:53.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.063+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ac8045b20 con 0x7f6ad40aac50 2024-08-15T17:53:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.063+0000 7f6abbfff700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ac0060860 0x7f6ac0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.063+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ac807dca0 con 0x7f6ad40aac50 2024-08-15T17:53:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.063+0000 7f6ad37fe700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ac0060860 0x7f6ac0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.063+0000 7f6ad37fe700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ac0060860 0x7f6ac0062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ad415eba0 tx=0x7f6ac4001ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.071+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ac804e1a0 con 0x7f6ad40aac50 2024-08-15T17:53:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.271+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad40ab300 con 0x7f6ad40aac50 2024-08-15T17:53:53.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6abbfff700 1 -- 172.21.15.33:0/4055091779 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f6ad40ab300 con 0x7f6ad40aac50 2024-08-15T17:53:53.275 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:53.275 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:53:53.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ac0060860 msgr2=0x7f6ac0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ac0060860 0x7f6ac0062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ad415eba0 tx=0x7f6ac4001ab0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 msgr2=0x7f6ad4169020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad4169020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8015000 tx=0x7f6ac8016000 comp rx=0 tx=0).stop 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 shutdown_connections 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ac0060860 0x7f6ac0062d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad415a2e0 0x7f6ad41457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad40b3b30 0x7f6ad40ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 --2- 172.21.15.33:0/4055091779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40aac50 0x7f6ad4169020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 >> 172.21.15.33:0/4055091779 conn(0x7f6ad40994d0 msgr2=0x7f6ad40b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 shutdown_connections 2024-08-15T17:53:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.275+0000 7f6ada66a700 1 -- 172.21.15.33:0/4055091779 wait complete. 2024-08-15T17:53:53.279 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:53:53.289 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:53.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.391+0000 7f0a61f97700 1 Processor -- start 2024-08-15T17:53:53.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- start start 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a5c155d20 0x7f0a5c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c06e8b0 con 0x7f0a5c0ad7c0 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c0adc10 con 0x7f0a5c155d20 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0af2b0 con 0x7f0a5c06df10 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0a5c0ad7c0 0x7f0a5c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59134/0 (socket says 172.21.15.33:59134) 2024-08-15T17:53:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5bfff700 1 -- 172.21.15.33:0/411959396 learned_addr learned my addr 172.21.15.33:0/411959396 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:53.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61796700 1 --2- 172.21.15.33:0/411959396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a60f95700 1 --2- 172.21.15.33:0/411959396 >> v2:172.21.15.105:3300/0 conn(0x7f0a5c155d20 0x7f0a5c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5b7fe700 1 -- 172.21.15.33:0/411959396 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847942030 0 0) 0x7f0a44001110 con 0x7f0a5c0ad7c0 2024-08-15T17:53:53.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5b7fe700 1 -- 172.21.15.33:0/411959396 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a48003570 con 0x7f0a5c0ad7c0 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61796700 1 -- 172.21.15.33:0/411959396 >> v2:172.21.15.105:3300/0 conn(0x7f0a5c155d20 msgr2=0x7f0a5c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61796700 1 --2- 172.21.15.33:0/411959396 >> v2:172.21.15.105:3300/0 conn(0x7f0a5c155d20 0x7f0a5c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61796700 1 -- 172.21.15.33:0/411959396 >> v1:172.21.15.33:6789/0 conn(0x7f0a5c0ad7c0 legacy=0x7f0a5c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61796700 1 -- 172.21.15.33:0/411959396 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0af590 con 0x7f0a5c06df10 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61796700 1 --2- 172.21.15.33:0/411959396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c06e370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009e60 tx=0x7f0a54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=715d68f191b5a6d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5b7fe700 1 -- 172.21.15.33:0/411959396 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400e070 con 0x7f0a5c06df10 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5b7fe700 1 -- 172.21.15.33:0/411959396 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5400bab0 con 0x7f0a5c06df10 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a5b7fe700 1 -- 172.21.15.33:0/411959396 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400be70 con 0x7f0a5c06df10 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- 172.21.15.33:0/411959396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 msgr2=0x7f0a5c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 --2- 172.21.15.33:0/411959396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c06e370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009e60 tx=0x7f0a54009780 comp rx=0 tx=0).stop 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- 172.21.15.33:0/411959396 shutdown_connections 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 --2- 172.21.15.33:0/411959396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c06e370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 --2- 172.21.15.33:0/411959396 >> v2:172.21.15.105:3300/0 conn(0x7f0a5c155d20 0x7f0a5c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- 172.21.15.33:0/411959396 >> 172.21.15.33:0/411959396 conn(0x7f0a5c0678d0 msgr2=0x7f0a5c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- 172.21.15.33:0/411959396 shutdown_connections 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.395+0000 7f0a61f97700 1 -- 172.21.15.33:0/411959396 wait complete. 2024-08-15T17:53:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 Processor -- start 2024-08-15T17:53:53.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 -- start start 2024-08-15T17:53:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c13d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0ad7c0 0x7f0a5c1413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 0x7f0a5c141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c141e60 con 0x7f0a5c155d20 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c142130 con 0x7f0a5c0ad7c0 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61f97700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c142410 con 0x7f0a5c06df10 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 0x7f0a5c141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 0x7f0a5c141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38438/0 (socket says 172.21.15.33:38438) 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 -- 172.21.15.33:0/3462214698 learned_addr learned my addr 172.21.15.33:0/3462214698 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a60f95700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c13d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a5bfff700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0ad7c0 0x7f0a5c1413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 -- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 msgr2=0x7f0a5c13d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c13d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 -- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0ad7c0 msgr2=0x7f0a5c1413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0ad7c0 0x7f0a5c1413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 -- 172.21.15.33:0/3462214698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54009a20 con 0x7f0a5c155d20 2024-08-15T17:53:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.399+0000 7f0a61796700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 0x7f0a5c141920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0b1d20 tx=0x7f0a54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54027470 con 0x7f0a5c155d20 2024-08-15T17:53:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a540275f0 con 0x7f0a5c155d20 2024-08-15T17:53:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540279b0 con 0x7f0a5c155d20 2024-08-15T17:53:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c1426f0 con 0x7f0a5c155d20 2024-08-15T17:53:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c142cb0 con 0x7f0a5c155d20 2024-08-15T17:53:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c0b1230 con 0x7f0a5c155d20 2024-08-15T17:53:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0a54024070 con 0x7f0a5c155d20 2024-08-15T17:53:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a58ff9700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a3c060860 0x7f0a3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a5407f610 con 0x7f0a5c155d20 2024-08-15T17:53:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.403+0000 7f0a60f95700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a3c060860 0x7f0a3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.407+0000 7f0a60f95700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a3c060860 0x7f0a3c062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009ca0 tx=0x7f0a4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.411+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0a5c0b1230 con 0x7f0a5c155d20 2024-08-15T17:53:53.558 INFO:tasks.ceph.mds.a.smithi033.stderr:2024-08-15T17:53:53.555+0000 7fdc654f6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-15T17:53:53.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.575+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a5c0b1230 con 0x7f0a5c155d20 2024-08-15T17:53:53.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a58ff9700 1 -- 172.21.15.33:0/3462214698 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0a5c0b1230 con 0x7f0a5c155d20 2024-08-15T17:53:53.580 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:53.580 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a3c060860 msgr2=0x7f0a3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a3c060860 0x7f0a3c062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009ca0 tx=0x7f0a4c008040 comp rx=0 tx=0).stop 2024-08-15T17:53:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 msgr2=0x7f0a5c141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 0x7f0a5c141920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0b1d20 tx=0x7f0a54019000 comp rx=0 tx=0).stop 2024-08-15T17:53:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 shutdown_connections 2024-08-15T17:53:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a3c060860 0x7f0a3c062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0ad7c0 0x7f0a5c1413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a5c155d20 0x7f0a5c141920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 --2- 172.21.15.33:0/3462214698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5c06df10 0x7f0a5c13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 >> 172.21.15.33:0/3462214698 conn(0x7f0a5c0678d0 msgr2=0x7f0a5c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 shutdown_connections 2024-08-15T17:53:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.579+0000 7f0a61f97700 1 -- 172.21.15.33:0/3462214698 wait complete. 2024-08-15T17:53:53.593 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-15T17:53:53.593 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:53:53.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 Processor -- start 2024-08-15T17:53:53.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 -- start start 2024-08-15T17:53:53.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe4155e00 0x7fabe4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fabe4069180 0x7fabe415a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe4069640 con 0x7fabe41561d0 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe415aa20 con 0x7fabe4069180 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabebd28700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe4069920 con 0x7fabe4155e00 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe92c3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fabe41561d0 0x7fabe40b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59148/0 (socket says 172.21.15.33:59148) 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe92c3700 1 -- 172.21.15.33:0/515532331 learned_addr learned my addr 172.21.15.33:0/515532331 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe9ac4700 1 --2- 172.21.15.33:0/515532331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe4155e00 0x7fabe4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabea2c5700 1 --2- 172.21.15.33:0/515532331 >> v2:172.21.15.105:3300/0 conn(0x7fabe4069180 0x7fabe415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe8ac2700 1 -- 172.21.15.33:0/515532331 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413733275 0 0) 0x7fabe4069640 con 0x7fabe41561d0 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe8ac2700 1 -- 172.21.15.33:0/515532331 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabcc003570 con 0x7fabe41561d0 2024-08-15T17:53:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe9ac4700 1 -- 172.21.15.33:0/515532331 >> v2:172.21.15.105:3300/0 conn(0x7fabe4069180 msgr2=0x7fabe415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:53.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe9ac4700 1 --2- 172.21.15.33:0/515532331 >> v2:172.21.15.105:3300/0 conn(0x7fabe4069180 0x7fabe415a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe9ac4700 1 -- 172.21.15.33:0/515532331 >> v1:172.21.15.33:6789/0 conn(0x7fabe41561d0 legacy=0x7fabe40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe9ac4700 1 -- 172.21.15.33:0/515532331 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4069c00 con 0x7fabe4155e00 2024-08-15T17:53:53.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe9ac4700 1 --2- 172.21.15.33:0/515532331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe4155e00 0x7fabe4159b30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabe00098e0 tx=0x7fabe00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed4bafa8d2c80765 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe8ac2700 1 -- 172.21.15.33:0/515532331 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011630 con 0x7fabe4155e00 2024-08-15T17:53:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe8ac2700 1 -- 172.21.15.33:0/515532331 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0011790 con 0x7fabe4155e00 2024-08-15T17:53:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.695+0000 7fabe8ac2700 1 -- 172.21.15.33:0/515532331 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011b10 con 0x7fabe4155e00 2024-08-15T17:53:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 -- 172.21.15.33:0/515532331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe4155e00 msgr2=0x7fabe4159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 --2- 172.21.15.33:0/515532331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe4155e00 0x7fabe4159b30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabe00098e0 tx=0x7fabe00091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 -- 172.21.15.33:0/515532331 shutdown_connections 2024-08-15T17:53:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 --2- 172.21.15.33:0/515532331 >> v2:172.21.15.105:3300/0 conn(0x7fabe4069180 0x7fabe415a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 --2- 172.21.15.33:0/515532331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe4155e00 0x7fabe4159b30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 -- 172.21.15.33:0/515532331 >> 172.21.15.33:0/515532331 conn(0x7fabe406e3b0 msgr2=0x7fabe40aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 -- 172.21.15.33:0/515532331 shutdown_connections 2024-08-15T17:53:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 -- 172.21.15.33:0/515532331 wait complete. 2024-08-15T17:53:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 Processor -- start 2024-08-15T17:53:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.699+0000 7fabebd28700 1 -- start start 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 0x7fabe415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe4155e00 0x7fabe414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe41561d0 0x7fabe415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe415caf0 con 0x7fabe4069180 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe41686b0 con 0x7fabe4155e00 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe415b3e0 con 0x7fabe41561d0 2024-08-15T17:53:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 0x7fabe415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 0x7fabe415b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38446/0 (socket says 172.21.15.33:38446) 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 -- 172.21.15.33:0/2816652868 learned_addr learned my addr 172.21.15.33:0/2816652868 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe92c3700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe4155e00 0x7fabe414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabea2c5700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe41561d0 0x7fabe415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 -- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe41561d0 msgr2=0x7fabe415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe41561d0 0x7fabe415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 -- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe4155e00 msgr2=0x7fabe414a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe4155e00 0x7fabe414a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 -- 172.21.15.33:0/2816652868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009420 con 0x7fabe4069180 2024-08-15T17:53:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabe9ac4700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 0x7fabe415b870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009ed0 tx=0x7fabe0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011900 con 0x7fabe4069180 2024-08-15T17:53:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0011a60 con 0x7fabe4069180 2024-08-15T17:53:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe414adc0 con 0x7fabe4069180 2024-08-15T17:53:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe001a680 con 0x7fabe4069180 2024-08-15T17:53:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.703+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe415ad90 con 0x7fabe4069180 2024-08-15T17:53:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.707+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe40645c0 con 0x7fabe4069180 2024-08-15T17:53:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.707+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fabe001aa70 con 0x7fabe4069180 2024-08-15T17:53:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.707+0000 7fabd9ffb700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabd0060860 0x7fabd0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.707+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabe007e6c0 con 0x7fabe4069180 2024-08-15T17:53:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.707+0000 7fabe92c3700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabd0060860 0x7fabd0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.707+0000 7fabe92c3700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabd0060860 0x7fabd0062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabe40c9850 tx=0x7fabdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.715+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fabe004eb50 con 0x7fabe4069180 2024-08-15T17:53:53.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.875+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabe415b520 con 0x7fabd0060860 2024-08-15T17:53:53.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.887+0000 7fabd9ffb700 1 -- 172.21.15.33:0/2816652868 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257883 (secure 0 0 0) 0x7fabdc00fc10 con 0x7fabd0060860 2024-08-15T17:53:53.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabd0060860 msgr2=0x7fabd0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabd0060860 0x7fabd0062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabe40c9850 tx=0x7fabdc009040 comp rx=0 tx=0).stop 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 msgr2=0x7fabe415b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 0x7fabe415b870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009ed0 tx=0x7fabe0017000 comp rx=0 tx=0).stop 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 shutdown_connections 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabd0060860 0x7fabd0062d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe4155e00 0x7fabe414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe41561d0 0x7fabe415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 --2- 172.21.15.33:0/2816652868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4069180 0x7fabe415b870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 >> 172.21.15.33:0/2816652868 conn(0x7fabe406e3b0 msgr2=0x7fabe40cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 shutdown_connections 2024-08-15T17:53:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:53.895+0000 7fabebd28700 1 -- 172.21.15.33:0/2816652868 wait complete. 2024-08-15T17:53:53.898 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:53:53.915 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-15T17:53:52.237781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2385636,"kb_used_data":2616,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752589084,"statfs":{"total":773094113280,"available":770651222016,"internally_reserved":0,"allocated":2678784,"data_stored":1652674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911772+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.911772+0000","last_peered":"2024-08-15T17:53:50.911772+0000","last_clean":"2024-08-15T17:53:50.911772+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.911772+0000","last_undegraded":"2024-08-15T17:53:50.911772+0000","last_fullsized":"2024-08-15T17:53:50.911772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915015+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.915015+0000","last_peered":"2024-08-15T17:53:50.915015+0000","last_clean":"2024-08-15T17:53:50.915015+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.915015+0000","last_undegraded":"2024-08-15T17:53:50.915015+0000","last_fullsized":"2024-08-15T17:53:50.915015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905096+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.905096+0000","last_peered":"2024-08-15T17:53:50.905096+0000","last_clean":"2024-08-15T17:53:50.905096+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.905096+0000","last_undegraded":"2024-08-15T17:53:50.905096+0000","last_fullsized":"2024-08-15T17:53:50.905096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921521+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.921521+0000","last_peered":"2024-08-15T17:53:50.921521+0000","last_clean":"2024-08-15T17:53:50.921521+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.921521+0000","last_undegraded":"2024-08-15T17:53:50.921521+0000","last_fullsized":"2024-08-15T17:53:50.921521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910014+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.910014+0000","last_peered":"2024-08-15T17:53:50.910014+0000","last_clean":"2024-08-15T17:53:50.910014+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.910014+0000","last_undegraded":"2024-08-15T17:53:50.910014+0000","last_fullsized":"2024-08-15T17:53:50.910014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912445+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.912445+0000","last_peered":"2024-08-15T17:53:50.912445+0000","last_clean":"2024-08-15T17:53:50.912445+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.912445+0000","last_undegraded":"2024-08-15T17:53:50.912445+0000","last_fullsized":"2024-08-15T17:53:50.912445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907943+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.907943+0000","last_peered":"2024-08-15T17:53:50.907943+0000","last_clean":"2024-08-15T17:53:50.907943+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.907943+0000","last_undegraded":"2024-08-15T17:53:50.907943+0000","last_fullsized":"2024-08-15T17:53:50.907943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903857+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.903857+0000","last_peered":"2024-08-15T17:53:50.903857+0000","last_clean":"2024-08-15T17:53:50.903857+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.903857+0000","last_undegraded":"2024-08-15T17:53:50.903857+0000","last_fullsized":"2024-08-15T17:53:50.903857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905188+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.905188+0000","last_peered":"2024-08-15T17:53:50.905188+0000","last_clean":"2024-08-15T17:53:50.905188+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.905188+0000","last_undegraded":"2024-08-15T17:53:50.905188+0000","last_fullsized":"2024-08-15T17:53:50.905188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916679+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.916679+0000","last_peered":"2024-08-15T17:53:50.916679+0000","last_clean":"2024-08-15T17:53:50.916679+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.916679+0000","last_undegraded":"2024-08-15T17:53:50.916679+0000","last_fullsized":"2024-08-15T17:53:50.916679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903300+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.903300+0000","last_peered":"2024-08-15T17:53:50.903300+0000","last_clean":"2024-08-15T17:53:50.903300+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.903300+0000","last_undegraded":"2024-08-15T17:53:50.903300+0000","last_fullsized":"2024-08-15T17:53:50.903300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911467+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.911467+0000","last_peered":"2024-08-15T17:53:50.911467+0000","last_clean":"2024-08-15T17:53:50.911467+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.911467+0000","last_undegraded":"2024-08-15T17:53:50.911467+0000","last_fullsized":"2024-08-15T17:53:50.911467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913215+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.913215+0000","last_peered":"2024-08-15T17:53:50.913215+0000","last_clean":"2024-08-15T17:53:50.913215+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.913215+0000","last_undegraded":"2024-08-15T17:53:50.913215+0000","last_fullsized":"2024-08-15T17:53:50.913215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907121+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.907121+0000","last_peered":"2024-08-15T17:53:50.907121+0000","last_clean":"2024-08-15T17:53:50.907121+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.907121+0000","last_undegraded":"2024-08-15T17:53:50.907121+0000","last_fullsized":"2024-08-15T17:53:50.907121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912441+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.912441+0000","last_peered":"2024-08-15T17:53:50.912441+0000","last_clean":"2024-08-15T17:53:50.912441+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.912441+0000","last_undegraded":"2024-08-15T17:53:50.912441+0000","last_fullsized":"2024-08-15T17:53:50.912441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910305+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.910305+0000","last_peered":"2024-08-15T17:53:50.910305+0000","last_clean":"2024-08-15T17:53:50.910305+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.910305+0000","last_undegraded":"2024-08-15T17:53:50.910305+0000","last_fullsized":"2024-08-15T17:53:50.910305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912383+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.912383+0000","last_peered":"2024-08-15T17:53:50.912383+0000","last_clean":"2024-08-15T17:53:50.912383+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.912383+0000","last_undegraded":"2024-08-15T17:53:50.912383+0000","last_fullsized":"2024-08-15T17:53:50.912383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901062+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.901062+0000","last_peered":"2024-08-15T17:53:50.901062+0000","last_clean":"2024-08-15T17:53:50.901062+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.901062+0000","last_undegraded":"2024-08-15T17:53:50.901062+0000","last_fullsized":"2024-08-15T17:53:50.901062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905354+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.905354+0000","last_peered":"2024-08-15T17:53:50.905354+0000","last_clean":"2024-08-15T17:53:50.905354+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.905354+0000","last_undegraded":"2024-08-15T17:53:50.905354+0000","last_fullsized":"2024-08-15T17:53:50.905354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915456+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:49.915456+0000","last_peered":"2024-08-15T17:53:49.915456+0000","last_clean":"2024-08-15T17:53:49.915456+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:49.915456+0000","last_undegraded":"2024-08-15T17:53:49.915456+0000","last_fullsized":"2024-08-15T17:53:49.915456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913318+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.913318+0000","last_peered":"2024-08-15T17:53:50.913318+0000","last_clean":"2024-08-15T17:53:50.913318+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.913318+0000","last_undegraded":"2024-08-15T17:53:50.913318+0000","last_fullsized":"2024-08-15T17:53:50.913318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910666+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.910666+0000","last_peered":"2024-08-15T17:53:50.910666+0000","last_clean":"2024-08-15T17:53:50.910666+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.910666+0000","last_undegraded":"2024-08-15T17:53:50.910666+0000","last_fullsized":"2024-08-15T17:53:50.910666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.908634+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:49.908634+0000","last_peered":"2024-08-15T17:53:49.908634+0000","last_clean":"2024-08-15T17:53:49.908634+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:49.908634+0000","last_undegraded":"2024-08-15T17:53:49.908634+0000","last_fullsized":"2024-08-15T17:53:49.908634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905961+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.905961+0000","last_peered":"2024-08-15T17:53:50.905961+0000","last_clean":"2024-08-15T17:53:50.905961+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.905961+0000","last_undegraded":"2024-08-15T17:53:50.905961+0000","last_fullsized":"2024-08-15T17:53:50.905961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929634+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929634+0000","last_peered":"2024-08-15T17:53:50.929634+0000","last_clean":"2024-08-15T17:53:50.929634+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929634+0000","last_undegraded":"2024-08-15T17:53:50.929634+0000","last_fullsized":"2024-08-15T17:53:50.929634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928289+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928289+0000","last_peered":"2024-08-15T17:53:50.928289+0000","last_clean":"2024-08-15T17:53:50.928289+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928289+0000","last_undegraded":"2024-08-15T17:53:50.928289+0000","last_fullsized":"2024-08-15T17:53:50.928289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921696+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.921696+0000","last_peered":"2024-08-15T17:53:50.921696+0000","last_clean":"2024-08-15T17:53:50.921696+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.921696+0000","last_undegraded":"2024-08-15T17:53:50.921696+0000","last_fullsized":"2024-08-15T17:53:50.921696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912426+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.912426+0000","last_peered":"2024-08-15T17:53:50.912426+0000","last_clean":"2024-08-15T17:53:50.912426+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.912426+0000","last_undegraded":"2024-08-15T17:53:50.912426+0000","last_fullsized":"2024-08-15T17:53:50.912426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935090+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935090+0000","last_peered":"2024-08-15T17:53:50.935090+0000","last_clean":"2024-08-15T17:53:50.935090+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935090+0000","last_undegraded":"2024-08-15T17:53:50.935090+0000","last_fullsized":"2024-08-15T17:53:50.935090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926959+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.926959+0000","last_peered":"2024-08-15T17:53:50.926959+0000","last_clean":"2024-08-15T17:53:50.926959+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.926959+0000","last_undegraded":"2024-08-15T17:53:50.926959+0000","last_fullsized":"2024-08-15T17:53:50.926959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901201+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.901201+0000","last_peered":"2024-08-15T17:53:50.901201+0000","last_clean":"2024-08-15T17:53:50.901201+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.901201+0000","last_undegraded":"2024-08-15T17:53:50.901201+0000","last_fullsized":"2024-08-15T17:53:50.901201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915462+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:49.915462+0000","last_peered":"2024-08-15T17:53:49.915462+0000","last_clean":"2024-08-15T17:53:49.915462+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:49.915462+0000","last_undegraded":"2024-08-15T17:53:49.915462+0000","last_fullsized":"2024-08-15T17:53:49.915462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.896396+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:49.896396+0000","last_peered":"2024-08-15T17:53:49.896396+0000","last_clean":"2024-08-15T17:53:49.896396+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:49.896396+0000","last_undegraded":"2024-08-15T17:53:49.896396+0000","last_fullsized":"2024-08-15T17:53:49.896396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905075+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.905075+0000","last_peered":"2024-08-15T17:53:50.905075+0000","last_clean":"2024-08-15T17:53:50.905075+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.905075+0000","last_undegraded":"2024-08-15T17:53:50.905075+0000","last_fullsized":"2024-08-15T17:53:50.905075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906668+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.906668+0000","last_peered":"2024-08-15T17:53:50.906668+0000","last_clean":"2024-08-15T17:53:50.906668+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906668+0000","last_undegraded":"2024-08-15T17:53:50.906668+0000","last_fullsized":"2024-08-15T17:53:50.906668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915216+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:49.915216+0000","last_peered":"2024-08-15T17:53:49.915216+0000","last_clean":"2024-08-15T17:53:49.915216+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:49.915216+0000","last_undegraded":"2024-08-15T17:53:49.915216+0000","last_fullsized":"2024-08-15T17:53:49.915216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913148+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.913148+0000","last_peered":"2024-08-15T17:53:50.913148+0000","last_clean":"2024-08-15T17:53:50.913148+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.913148+0000","last_undegraded":"2024-08-15T17:53:50.913148+0000","last_fullsized":"2024-08-15T17:53:50.913148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917918+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:49.917918+0000","last_peered":"2024-08-15T17:53:49.917918+0000","last_clean":"2024-08-15T17:53:49.917918+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:49.917918+0000","last_undegraded":"2024-08-15T17:53:49.917918+0000","last_fullsized":"2024-08-15T17:53:49.917918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907678+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.907678+0000","last_peered":"2024-08-15T17:53:50.907678+0000","last_clean":"2024-08-15T17:53:50.907678+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.907678+0000","last_undegraded":"2024-08-15T17:53:50.907678+0000","last_fullsized":"2024-08-15T17:53:50.907678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917817+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:49.917817+0000","last_peered":"2024-08-15T17:53:49.917817+0000","last_clean":"2024-08-15T17:53:49.917817+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:49.917817+0000","last_undegraded":"2024-08-15T17:53:49.917817+0000","last_fullsized":"2024-08-15T17:53:49.917817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906946+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.906946+0000","last_peered":"2024-08-15T17:53:50.906946+0000","last_clean":"2024-08-15T17:53:50.906946+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906946+0000","last_undegraded":"2024-08-15T17:53:50.906946+0000","last_fullsized":"2024-08-15T17:53:50.906946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907271+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.907271+0000","last_peered":"2024-08-15T17:53:50.907271+0000","last_clean":"2024-08-15T17:53:50.907271+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.907271+0000","last_undegraded":"2024-08-15T17:53:50.907271+0000","last_fullsized":"2024-08-15T17:53:50.907271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915065+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:49.915065+0000","last_peered":"2024-08-15T17:53:49.915065+0000","last_clean":"2024-08-15T17:53:49.915065+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:49.915065+0000","last_undegraded":"2024-08-15T17:53:49.915065+0000","last_fullsized":"2024-08-15T17:53:49.915065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907755+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.907755+0000","last_peered":"2024-08-15T17:53:50.907755+0000","last_clean":"2024-08-15T17:53:50.907755+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.907755+0000","last_undegraded":"2024-08-15T17:53:50.907755+0000","last_fullsized":"2024-08-15T17:53:50.907755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915510+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:49.915510+0000","last_peered":"2024-08-15T17:53:49.915510+0000","last_clean":"2024-08-15T17:53:49.915510+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:49.915510+0000","last_undegraded":"2024-08-15T17:53:49.915510+0000","last_fullsized":"2024-08-15T17:53:49.915510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910580+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.910580+0000","last_peered":"2024-08-15T17:53:50.910580+0000","last_clean":"2024-08-15T17:53:50.910580+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.910580+0000","last_undegraded":"2024-08-15T17:53:50.910580+0000","last_fullsized":"2024-08-15T17:53:50.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913554+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.913554+0000","last_peered":"2024-08-15T17:53:50.913554+0000","last_clean":"2024-08-15T17:53:50.913554+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.913554+0000","last_undegraded":"2024-08-15T17:53:50.913554+0000","last_fullsized":"2024-08-15T17:53:50.913554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910641+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.910641+0000","last_peered":"2024-08-15T17:53:50.910641+0000","last_clean":"2024-08-15T17:53:50.910641+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.910641+0000","last_undegraded":"2024-08-15T17:53:50.910641+0000","last_fullsized":"2024-08-15T17:53:50.910641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901431+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.901431+0000","last_peered":"2024-08-15T17:53:50.901431+0000","last_clean":"2024-08-15T17:53:50.901431+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.901431+0000","last_undegraded":"2024-08-15T17:53:50.901431+0000","last_fullsized":"2024-08-15T17:53:50.901431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.908002+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.908002+0000","last_peered":"2024-08-15T17:53:50.908002+0000","last_clean":"2024-08-15T17:53:50.908002+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.908002+0000","last_undegraded":"2024-08-15T17:53:50.908002+0000","last_fullsized":"2024-08-15T17:53:50.908002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927882+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.927882+0000","last_peered":"2024-08-15T17:53:50.927882+0000","last_clean":"2024-08-15T17:53:50.927882+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.927882+0000","last_undegraded":"2024-08-15T17:53:50.927882+0000","last_fullsized":"2024-08-15T17:53:50.927882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":32,"acting":32,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":47756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":47756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":47756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":66711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":184320,"data_stored":59824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":798720,"data_stored":657047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":68799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":794624,"data_stored":657025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:53:53.920 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:53:54.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 Processor -- start 2024-08-15T17:53:54.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- start start 2024-08-15T17:53:54.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5f015d540 0x7fa5f00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f00a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5f00a9260 0x7fa5f00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00b0270 con 0x7fa5f00a9260 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00af660 con 0x7fa5f015d540 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00af940 con 0x7fa5f006e830 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5ef7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5f00a9260 0x7fa5f00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5f015d540 0x7fa5f00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5ef7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5f00a9260 0x7fa5f00b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38452/0 (socket says 172.21.15.33:38452) 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5ee7fc700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f00a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5ef7fe700 1 -- 172.21.15.33:0/3688294007 learned_addr learned my addr 172.21.15.33:0/3688294007 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 -- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 msgr2=0x7fa5f00a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f00a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 -- 172.21.15.33:0/3688294007 >> v2:172.21.15.33:3300/0 conn(0x7fa5f00a9260 msgr2=0x7fa5f00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 --2- 172.21.15.33:0/3688294007 >> v2:172.21.15.33:3300/0 conn(0x7fa5f00a9260 0x7fa5f00b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 -- 172.21.15.33:0/3688294007 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00afc20 con 0x7fa5f015d540 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5ee7fc700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f00a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5eeffd700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f015d540 0x7fa5f00af030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5f006b2d0 tx=0x7fa5e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4753a327eaabf153 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5edffb700 1 -- 172.21.15.33:0/3688294007 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0011630 con 0x7fa5f015d540 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5edffb700 1 -- 172.21.15.33:0/3688294007 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00117b0 con 0x7fa5f015d540 2024-08-15T17:53:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5edffb700 1 -- 172.21.15.33:0/3688294007 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0011b70 con 0x7fa5f015d540 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f015d540 msgr2=0x7fa5f00af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f015d540 0x7fa5f00af030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5f006b2d0 tx=0x7fa5e00091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- 172.21.15.33:0/3688294007 shutdown_connections 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- 172.21.15.33:0/3688294007 >> v2:172.21.15.33:3300/0 conn(0x7fa5f00a9260 0x7fa5f00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f00a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 --2- 172.21.15.33:0/3688294007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f015d540 0x7fa5f00af030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- 172.21.15.33:0/3688294007 >> 172.21.15.33:0/3688294007 conn(0x7fa5f0066e00 msgr2=0x7fa5f0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- 172.21.15.33:0/3688294007 shutdown_connections 2024-08-15T17:53:54.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.031+0000 7fa5f586a700 1 -- 172.21.15.33:0/3688294007 wait complete. 2024-08-15T17:53:54.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 Processor -- start 2024-08-15T17:53:54.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 -- start start 2024-08-15T17:53:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f00a9260 0x7fa5f0069220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5f015d540 0x7fa5f0069760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f016ddb0 con 0x7fa5f015d540 2024-08-15T17:53:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f016e090 con 0x7fa5f00a9260 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5f586a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f016e370 con 0x7fa5f006e830 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5f015d540 0x7fa5f0069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5eeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5f015d540 0x7fa5f0069760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38464/0 (socket says 172.21.15.33:38464) 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5ef7fe700 1 -- 172.21.15.33:0/1045446259 learned_addr learned my addr 172.21.15.33:0/1045446259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5ee7fc700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f00a9260 0x7fa5f0069220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5eeffd700 1 -- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f00a9260 msgr2=0x7fa5f0069220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5eeffd700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f00a9260 0x7fa5f0069220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5eeffd700 1 -- 172.21.15.33:0/1045446259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5f015d540 msgr2=0x7fa5f0069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5eeffd700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5f015d540 0x7fa5f0069760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.035+0000 7fa5eeffd700 1 -- 172.21.15.33:0/1045446259 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e4009420 con 0x7fa5f006e830 2024-08-15T17:53:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5eeffd700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f014d110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0016000 tx=0x7fa5e0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e001f070 con 0x7fa5f006e830 2024-08-15T17:53:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0002f30 con 0x7fa5f006e830 2024-08-15T17:53:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e0009420 con 0x7fa5f006e830 2024-08-15T17:53:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0011920 con 0x7fa5f006e830 2024-08-15T17:53:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f016e930 con 0x7fa5f006e830 2024-08-15T17:53:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00645c0 con 0x7fa5f006e830 2024-08-15T17:53:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa5e0023070 con 0x7fa5f006e830 2024-08-15T17:53:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5d6ffd700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa5dc060860 0x7fa5dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5e007dcc0 con 0x7fa5f006e830 2024-08-15T17:53:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.039+0000 7fa5ee7fc700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa5dc060860 0x7fa5dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.043+0000 7fa5ee7fc700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa5dc060860 0x7fa5dc062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0069f60 tx=0x7fa5e40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.051+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa5e0084080 con 0x7fa5f006e830 2024-08-15T17:53:54.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.211+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5f006f360 con 0x7fa5dc060860 2024-08-15T17:53:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.227+0000 7fa5d6ffd700 1 -- 172.21.15.33:0/1045446259 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257883 (secure 0 0 0) 0x7fa5f006f360 con 0x7fa5dc060860 2024-08-15T17:53:54.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:54.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa5dc060860 msgr2=0x7fa5dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa5dc060860 0x7fa5dc062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0069f60 tx=0x7fa5e40091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 msgr2=0x7fa5f014d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f014d110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0016000 tx=0x7fa5e0017000 comp rx=0 tx=0).stop 2024-08-15T17:53:54.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 shutdown_connections 2024-08-15T17:53:54.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa5dc060860 0x7fa5dc062d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f00a9260 0x7fa5f0069220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5f015d540 0x7fa5f0069760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 --2- 172.21.15.33:0/1045446259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f006e830 0x7fa5f014d110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 >> 172.21.15.33:0/1045446259 conn(0x7fa5f0066e00 msgr2=0x7fa5f006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 shutdown_connections 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.235+0000 7fa5f586a700 1 -- 172.21.15.33:0/1045446259 wait complete. 2024-08-15T17:53:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:53:54.249 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-15T17:53:52.237781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2385636,"kb_used_data":2616,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752589084,"statfs":{"total":773094113280,"available":770651222016,"internally_reserved":0,"allocated":2678784,"data_stored":1652674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911772+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.911772+0000","last_peered":"2024-08-15T17:53:50.911772+0000","last_clean":"2024-08-15T17:53:50.911772+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.911772+0000","last_undegraded":"2024-08-15T17:53:50.911772+0000","last_fullsized":"2024-08-15T17:53:50.911772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915015+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.915015+0000","last_peered":"2024-08-15T17:53:50.915015+0000","last_clean":"2024-08-15T17:53:50.915015+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.915015+0000","last_undegraded":"2024-08-15T17:53:50.915015+0000","last_fullsized":"2024-08-15T17:53:50.915015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905096+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.905096+0000","last_peered":"2024-08-15T17:53:50.905096+0000","last_clean":"2024-08-15T17:53:50.905096+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.905096+0000","last_undegraded":"2024-08-15T17:53:50.905096+0000","last_fullsized":"2024-08-15T17:53:50.905096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921521+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.921521+0000","last_peered":"2024-08-15T17:53:50.921521+0000","last_clean":"2024-08-15T17:53:50.921521+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.921521+0000","last_undegraded":"2024-08-15T17:53:50.921521+0000","last_fullsized":"2024-08-15T17:53:50.921521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910014+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.910014+0000","last_peered":"2024-08-15T17:53:50.910014+0000","last_clean":"2024-08-15T17:53:50.910014+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.910014+0000","last_undegraded":"2024-08-15T17:53:50.910014+0000","last_fullsized":"2024-08-15T17:53:50.910014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912445+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.912445+0000","last_peered":"2024-08-15T17:53:50.912445+0000","last_clean":"2024-08-15T17:53:50.912445+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.912445+0000","last_undegraded":"2024-08-15T17:53:50.912445+0000","last_fullsized":"2024-08-15T17:53:50.912445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907943+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.907943+0000","last_peered":"2024-08-15T17:53:50.907943+0000","last_clean":"2024-08-15T17:53:50.907943+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.907943+0000","last_undegraded":"2024-08-15T17:53:50.907943+0000","last_fullsized":"2024-08-15T17:53:50.907943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903857+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.903857+0000","last_peered":"2024-08-15T17:53:50.903857+0000","last_clean":"2024-08-15T17:53:50.903857+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.903857+0000","last_undegraded":"2024-08-15T17:53:50.903857+0000","last_fullsized":"2024-08-15T17:53:50.903857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905188+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.905188+0000","last_peered":"2024-08-15T17:53:50.905188+0000","last_clean":"2024-08-15T17:53:50.905188+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.905188+0000","last_undegraded":"2024-08-15T17:53:50.905188+0000","last_fullsized":"2024-08-15T17:53:50.905188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916679+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.916679+0000","last_peered":"2024-08-15T17:53:50.916679+0000","last_clean":"2024-08-15T17:53:50.916679+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.916679+0000","last_undegraded":"2024-08-15T17:53:50.916679+0000","last_fullsized":"2024-08-15T17:53:50.916679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903300+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.903300+0000","last_peered":"2024-08-15T17:53:50.903300+0000","last_clean":"2024-08-15T17:53:50.903300+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.903300+0000","last_undegraded":"2024-08-15T17:53:50.903300+0000","last_fullsized":"2024-08-15T17:53:50.903300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911467+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.911467+0000","last_peered":"2024-08-15T17:53:50.911467+0000","last_clean":"2024-08-15T17:53:50.911467+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.911467+0000","last_undegraded":"2024-08-15T17:53:50.911467+0000","last_fullsized":"2024-08-15T17:53:50.911467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913215+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.913215+0000","last_peered":"2024-08-15T17:53:50.913215+0000","last_clean":"2024-08-15T17:53:50.913215+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.913215+0000","last_undegraded":"2024-08-15T17:53:50.913215+0000","last_fullsized":"2024-08-15T17:53:50.913215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907121+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.907121+0000","last_peered":"2024-08-15T17:53:50.907121+0000","last_clean":"2024-08-15T17:53:50.907121+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.907121+0000","last_undegraded":"2024-08-15T17:53:50.907121+0000","last_fullsized":"2024-08-15T17:53:50.907121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912441+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.912441+0000","last_peered":"2024-08-15T17:53:50.912441+0000","last_clean":"2024-08-15T17:53:50.912441+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.912441+0000","last_undegraded":"2024-08-15T17:53:50.912441+0000","last_fullsized":"2024-08-15T17:53:50.912441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910305+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.910305+0000","last_peered":"2024-08-15T17:53:50.910305+0000","last_clean":"2024-08-15T17:53:50.910305+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.910305+0000","last_undegraded":"2024-08-15T17:53:50.910305+0000","last_fullsized":"2024-08-15T17:53:50.910305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912383+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.912383+0000","last_peered":"2024-08-15T17:53:50.912383+0000","last_clean":"2024-08-15T17:53:50.912383+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.912383+0000","last_undegraded":"2024-08-15T17:53:50.912383+0000","last_fullsized":"2024-08-15T17:53:50.912383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901062+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.901062+0000","last_peered":"2024-08-15T17:53:50.901062+0000","last_clean":"2024-08-15T17:53:50.901062+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.901062+0000","last_undegraded":"2024-08-15T17:53:50.901062+0000","last_fullsized":"2024-08-15T17:53:50.901062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905354+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.905354+0000","last_peered":"2024-08-15T17:53:50.905354+0000","last_clean":"2024-08-15T17:53:50.905354+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.905354+0000","last_undegraded":"2024-08-15T17:53:50.905354+0000","last_fullsized":"2024-08-15T17:53:50.905354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915456+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:49.915456+0000","last_peered":"2024-08-15T17:53:49.915456+0000","last_clean":"2024-08-15T17:53:49.915456+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:49.915456+0000","last_undegraded":"2024-08-15T17:53:49.915456+0000","last_fullsized":"2024-08-15T17:53:49.915456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913318+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.913318+0000","last_peered":"2024-08-15T17:53:50.913318+0000","last_clean":"2024-08-15T17:53:50.913318+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.913318+0000","last_undegraded":"2024-08-15T17:53:50.913318+0000","last_fullsized":"2024-08-15T17:53:50.913318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910666+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.910666+0000","last_peered":"2024-08-15T17:53:50.910666+0000","last_clean":"2024-08-15T17:53:50.910666+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.910666+0000","last_undegraded":"2024-08-15T17:53:50.910666+0000","last_fullsized":"2024-08-15T17:53:50.910666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.908634+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:49.908634+0000","last_peered":"2024-08-15T17:53:49.908634+0000","last_clean":"2024-08-15T17:53:49.908634+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:49.908634+0000","last_undegraded":"2024-08-15T17:53:49.908634+0000","last_fullsized":"2024-08-15T17:53:49.908634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905961+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.905961+0000","last_peered":"2024-08-15T17:53:50.905961+0000","last_clean":"2024-08-15T17:53:50.905961+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.905961+0000","last_undegraded":"2024-08-15T17:53:50.905961+0000","last_fullsized":"2024-08-15T17:53:50.905961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929634+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929634+0000","last_peered":"2024-08-15T17:53:50.929634+0000","last_clean":"2024-08-15T17:53:50.929634+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929634+0000","last_undegraded":"2024-08-15T17:53:50.929634+0000","last_fullsized":"2024-08-15T17:53:50.929634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928289+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928289+0000","last_peered":"2024-08-15T17:53:50.928289+0000","last_clean":"2024-08-15T17:53:50.928289+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928289+0000","last_undegraded":"2024-08-15T17:53:50.928289+0000","last_fullsized":"2024-08-15T17:53:50.928289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921696+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.921696+0000","last_peered":"2024-08-15T17:53:50.921696+0000","last_clean":"2024-08-15T17:53:50.921696+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.921696+0000","last_undegraded":"2024-08-15T17:53:50.921696+0000","last_fullsized":"2024-08-15T17:53:50.921696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912426+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.912426+0000","last_peered":"2024-08-15T17:53:50.912426+0000","last_clean":"2024-08-15T17:53:50.912426+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.912426+0000","last_undegraded":"2024-08-15T17:53:50.912426+0000","last_fullsized":"2024-08-15T17:53:50.912426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935090+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935090+0000","last_peered":"2024-08-15T17:53:50.935090+0000","last_clean":"2024-08-15T17:53:50.935090+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935090+0000","last_undegraded":"2024-08-15T17:53:50.935090+0000","last_fullsized":"2024-08-15T17:53:50.935090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926959+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.926959+0000","last_peered":"2024-08-15T17:53:50.926959+0000","last_clean":"2024-08-15T17:53:50.926959+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.926959+0000","last_undegraded":"2024-08-15T17:53:50.926959+0000","last_fullsized":"2024-08-15T17:53:50.926959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901201+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.901201+0000","last_peered":"2024-08-15T17:53:50.901201+0000","last_clean":"2024-08-15T17:53:50.901201+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.901201+0000","last_undegraded":"2024-08-15T17:53:50.901201+0000","last_fullsized":"2024-08-15T17:53:50.901201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915462+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:49.915462+0000","last_peered":"2024-08-15T17:53:49.915462+0000","last_clean":"2024-08-15T17:53:49.915462+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:49.915462+0000","last_undegraded":"2024-08-15T17:53:49.915462+0000","last_fullsized":"2024-08-15T17:53:49.915462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.896396+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:49.896396+0000","last_peered":"2024-08-15T17:53:49.896396+0000","last_clean":"2024-08-15T17:53:49.896396+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:49.896396+0000","last_undegraded":"2024-08-15T17:53:49.896396+0000","last_fullsized":"2024-08-15T17:53:49.896396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905075+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.905075+0000","last_peered":"2024-08-15T17:53:50.905075+0000","last_clean":"2024-08-15T17:53:50.905075+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.905075+0000","last_undegraded":"2024-08-15T17:53:50.905075+0000","last_fullsized":"2024-08-15T17:53:50.905075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906668+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.906668+0000","last_peered":"2024-08-15T17:53:50.906668+0000","last_clean":"2024-08-15T17:53:50.906668+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906668+0000","last_undegraded":"2024-08-15T17:53:50.906668+0000","last_fullsized":"2024-08-15T17:53:50.906668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915216+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:49.915216+0000","last_peered":"2024-08-15T17:53:49.915216+0000","last_clean":"2024-08-15T17:53:49.915216+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:49.915216+0000","last_undegraded":"2024-08-15T17:53:49.915216+0000","last_fullsized":"2024-08-15T17:53:49.915216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913148+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.913148+0000","last_peered":"2024-08-15T17:53:50.913148+0000","last_clean":"2024-08-15T17:53:50.913148+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.913148+0000","last_undegraded":"2024-08-15T17:53:50.913148+0000","last_fullsized":"2024-08-15T17:53:50.913148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917918+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:49.917918+0000","last_peered":"2024-08-15T17:53:49.917918+0000","last_clean":"2024-08-15T17:53:49.917918+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:49.917918+0000","last_undegraded":"2024-08-15T17:53:49.917918+0000","last_fullsized":"2024-08-15T17:53:49.917918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907678+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.907678+0000","last_peered":"2024-08-15T17:53:50.907678+0000","last_clean":"2024-08-15T17:53:50.907678+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.907678+0000","last_undegraded":"2024-08-15T17:53:50.907678+0000","last_fullsized":"2024-08-15T17:53:50.907678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917817+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:49.917817+0000","last_peered":"2024-08-15T17:53:49.917817+0000","last_clean":"2024-08-15T17:53:49.917817+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:49.917817+0000","last_undegraded":"2024-08-15T17:53:49.917817+0000","last_fullsized":"2024-08-15T17:53:49.917817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906946+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.906946+0000","last_peered":"2024-08-15T17:53:50.906946+0000","last_clean":"2024-08-15T17:53:50.906946+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906946+0000","last_undegraded":"2024-08-15T17:53:50.906946+0000","last_fullsized":"2024-08-15T17:53:50.906946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907271+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.907271+0000","last_peered":"2024-08-15T17:53:50.907271+0000","last_clean":"2024-08-15T17:53:50.907271+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.907271+0000","last_undegraded":"2024-08-15T17:53:50.907271+0000","last_fullsized":"2024-08-15T17:53:50.907271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915065+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:49.915065+0000","last_peered":"2024-08-15T17:53:49.915065+0000","last_clean":"2024-08-15T17:53:49.915065+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:49.915065+0000","last_undegraded":"2024-08-15T17:53:49.915065+0000","last_fullsized":"2024-08-15T17:53:49.915065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907755+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.907755+0000","last_peered":"2024-08-15T17:53:50.907755+0000","last_clean":"2024-08-15T17:53:50.907755+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.907755+0000","last_undegraded":"2024-08-15T17:53:50.907755+0000","last_fullsized":"2024-08-15T17:53:50.907755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915510+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:49.915510+0000","last_peered":"2024-08-15T17:53:49.915510+0000","last_clean":"2024-08-15T17:53:49.915510+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:49.915510+0000","last_undegraded":"2024-08-15T17:53:49.915510+0000","last_fullsized":"2024-08-15T17:53:49.915510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910580+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.910580+0000","last_peered":"2024-08-15T17:53:50.910580+0000","last_clean":"2024-08-15T17:53:50.910580+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.910580+0000","last_undegraded":"2024-08-15T17:53:50.910580+0000","last_fullsized":"2024-08-15T17:53:50.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:49.870400+0000","last_change":"2024-08-15T17:53:49.870400+0000","last_active":"2024-08-15T17:53:49.870400+0000","last_peered":"2024-08-15T17:53:49.870400+0000","last_clean":"2024-08-15T17:53:49.870400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:49.870400+0000","last_undegraded":"2024-08-15T17:53:49.870400+0000","last_fullsized":"2024-08-15T17:53:49.870400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913554+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.913554+0000","last_peered":"2024-08-15T17:53:50.913554+0000","last_clean":"2024-08-15T17:53:50.913554+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.913554+0000","last_undegraded":"2024-08-15T17:53:50.913554+0000","last_fullsized":"2024-08-15T17:53:50.913554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:53:48.861357+0000","last_change":"2024-08-15T17:53:48.861357+0000","last_active":"2024-08-15T17:53:48.861357+0000","last_peered":"2024-08-15T17:53:48.861357+0000","last_clean":"2024-08-15T17:53:48.861357+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:53:48.861357+0000","last_undegraded":"2024-08-15T17:53:48.861357+0000","last_fullsized":"2024-08-15T17:53:48.861357+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910641+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.910641+0000","last_peered":"2024-08-15T17:53:50.910641+0000","last_clean":"2024-08-15T17:53:50.910641+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.910641+0000","last_undegraded":"2024-08-15T17:53:50.910641+0000","last_fullsized":"2024-08-15T17:53:50.910641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901431+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.901431+0000","last_peered":"2024-08-15T17:53:50.901431+0000","last_clean":"2024-08-15T17:53:50.901431+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.901431+0000","last_undegraded":"2024-08-15T17:53:50.901431+0000","last_fullsized":"2024-08-15T17:53:50.901431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.908002+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.908002+0000","last_peered":"2024-08-15T17:53:50.908002+0000","last_clean":"2024-08-15T17:53:50.908002+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.908002+0000","last_undegraded":"2024-08-15T17:53:50.908002+0000","last_fullsized":"2024-08-15T17:53:50.908002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927882+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.927882+0000","last_peered":"2024-08-15T17:53:50.927882+0000","last_clean":"2024-08-15T17:53:50.927882+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.927882+0000","last_undegraded":"2024-08-15T17:53:50.927882+0000","last_fullsized":"2024-08-15T17:53:50.927882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":32,"acting":32,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":47756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":47756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":159744,"data_stored":47756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":66711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":184320,"data_stored":59824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":798720,"data_stored":657047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":68799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":794624,"data_stored":657025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:53:54.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:53:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 Processor -- start 2024-08-15T17:53:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 -- start start 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f93b8155d20 0x7f93b80b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f93b80ad7c0 0x7f93b80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b80af2b0 con 0x7f93b806df10 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80adc10 con 0x7f93b8155d20 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bf00a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80af590 con 0x7f93b80ad7c0 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93be809700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f93b806df10 0x7f93b806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59150/0 (socket says 172.21.15.33:59150) 2024-08-15T17:53:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93be809700 1 -- 172.21.15.33:0/3713978511 learned_addr learned my addr 172.21.15.33:0/3713978511 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93be008700 1 --2- 172.21.15.33:0/3713978511 >> v2:172.21.15.33:3300/0 conn(0x7f93b8155d20 0x7f93b80b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.363+0000 7f93bd807700 1 --2- 172.21.15.33:0/3713978511 >> v2:172.21.15.105:3300/0 conn(0x7f93b80ad7c0 0x7f93b80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd006700 1 -- 172.21.15.33:0/3713978511 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059513811 0 0) 0x7f93b80af2b0 con 0x7f93b806df10 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd006700 1 -- 172.21.15.33:0/3713978511 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a4003570 con 0x7f93b806df10 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd807700 1 -- 172.21.15.33:0/3713978511 >> v2:172.21.15.33:3300/0 conn(0x7f93b8155d20 msgr2=0x7f93b80b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd807700 1 --2- 172.21.15.33:0/3713978511 >> v2:172.21.15.33:3300/0 conn(0x7f93b8155d20 0x7f93b80b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd807700 1 -- 172.21.15.33:0/3713978511 >> v1:172.21.15.33:6789/0 conn(0x7f93b806df10 legacy=0x7f93b806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd807700 1 -- 172.21.15.33:0/3713978511 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80af870 con 0x7f93b80ad7c0 2024-08-15T17:53:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd807700 1 --2- 172.21.15.33:0/3713978511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b80ad7c0 0x7f93b80aea80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93b806fb30 tx=0x7f93a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605bdd015ca7105f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd006700 1 -- 172.21.15.33:0/3713978511 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011630 con 0x7f93b80ad7c0 2024-08-15T17:53:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd006700 1 -- 172.21.15.33:0/3713978511 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8011790 con 0x7f93b80ad7c0 2024-08-15T17:53:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bd006700 1 -- 172.21.15.33:0/3713978511 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011b30 con 0x7f93b80ad7c0 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 -- 172.21.15.33:0/3713978511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b80ad7c0 msgr2=0x7f93b80aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3713978511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b80ad7c0 0x7f93b80aea80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93b806fb30 tx=0x7f93a80091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 -- 172.21.15.33:0/3713978511 shutdown_connections 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3713978511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b80ad7c0 0x7f93b80aea80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3713978511 >> v2:172.21.15.33:3300/0 conn(0x7f93b8155d20 0x7f93b80b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 -- 172.21.15.33:0/3713978511 >> 172.21.15.33:0/3713978511 conn(0x7f93b80678d0 msgr2=0x7f93b8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 -- 172.21.15.33:0/3713978511 shutdown_connections 2024-08-15T17:53:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 -- 172.21.15.33:0/3713978511 wait complete. 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 Processor -- start 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.367+0000 7f93bf00a700 1 -- start start 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b806df10 0x7f93b80a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b80ad7c0 0x7f93b80a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 0x7f93b8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80a6010 con 0x7f93b8155d20 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b81469f0 con 0x7f93b806df10 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8147250 con 0x7f93b80ad7c0 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 0x7f93b8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 0x7f93b8069530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38480/0 (socket says 172.21.15.33:38480) 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 -- 172.21.15.33:0/3021860546 learned_addr learned my addr 172.21.15.33:0/3021860546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be008700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b806df10 0x7f93b80a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bd807700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b80ad7c0 0x7f93b80a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 -- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b80ad7c0 msgr2=0x7f93b80a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b80ad7c0 0x7f93b80a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 -- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b806df10 msgr2=0x7f93b80a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b806df10 0x7f93b80a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 -- 172.21.15.33:0/3021860546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8009420 con 0x7f93b8155d20 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93be809700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 0x7f93b8069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93b000cbc0 tx=0x7f93b00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000a900 con 0x7f93b8155d20 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000aa60 con 0x7f93b8155d20 2024-08-15T17:53:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b80a5d30 con 0x7f93b8155d20 2024-08-15T17:53:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000ae20 con 0x7f93b8155d20 2024-08-15T17:53:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b8146ee0 con 0x7f93b8155d20 2024-08-15T17:53:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.371+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b80643a0 con 0x7f93b8155d20 2024-08-15T17:53:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.375+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f93b0007300 con 0x7f93b8155d20 2024-08-15T17:53:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.375+0000 7f93ae7fc700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f939c060860 0x7f939c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.375+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93b007cfa0 con 0x7f93b8155d20 2024-08-15T17:53:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.375+0000 7f93be008700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f939c060860 0x7f939c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.375+0000 7f93be008700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f939c060860 0x7f939c062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009d40 tx=0x7f93b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.379+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f93b004d470 con 0x7f93b8155d20 2024-08-15T17:53:54.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.539+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93b8147390 con 0x7f939c060860 2024-08-15T17:53:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.559+0000 7f93ae7fc700 1 -- 172.21.15.33:0/3021860546 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264567 (secure 0 0 0) 0x7f93b8147390 con 0x7f939c060860 2024-08-15T17:53:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f939c060860 msgr2=0x7f939c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f939c060860 0x7f939c062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009d40 tx=0x7f93b4008040 comp rx=0 tx=0).stop 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 msgr2=0x7f93b8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 0x7f93b8069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93b000cbc0 tx=0x7f93b00019c0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 shutdown_connections 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f939c060860 0x7f939c062d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b8155d20 0x7f93b8069530 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b80ad7c0 0x7f93b80a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 --2- 172.21.15.33:0/3021860546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b806df10 0x7f93b80a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 >> 172.21.15.33:0/3021860546 conn(0x7f93b80678d0 msgr2=0x7f93b8148830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 shutdown_connections 2024-08-15T17:53:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.563+0000 7f93bf00a700 1 -- 172.21.15.33:0/3021860546 wait complete. 2024-08-15T17:53:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:53:54.578 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-15T17:53:54.238384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385768,"kb_used_data":2748,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588952,"statfs":{"total":773094113280,"available":770651086848,"internally_reserved":0,"allocated":2813952,"data_stored":1711345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.365947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914055+0000","last_change":"2024-08-15T17:53:50.914055+0000","last_active":"2024-08-15T17:53:50.914055+0000","last_peered":"2024-08-15T17:53:50.914055+0000","last_clean":"2024-08-15T17:53:50.914055+0000","last_became_active":"2024-08-15T17:53:50.912515+0000","last_became_peered":"2024-08-15T17:53:50.912515+0000","last_unstale":"2024-08-15T17:53:50.914055+0000","last_undegraded":"2024-08-15T17:53:50.914055+0000","last_fullsized":"2024-08-15T17:53:50.914055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911772+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.911772+0000","last_peered":"2024-08-15T17:53:50.911772+0000","last_clean":"2024-08-15T17:53:50.911772+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.911772+0000","last_undegraded":"2024-08-15T17:53:50.911772+0000","last_fullsized":"2024-08-15T17:53:50.911772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915015+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.915015+0000","last_peered":"2024-08-15T17:53:50.915015+0000","last_clean":"2024-08-15T17:53:50.915015+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.915015+0000","last_undegraded":"2024-08-15T17:53:50.915015+0000","last_fullsized":"2024-08-15T17:53:50.915015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921467+0000","last_change":"2024-08-15T17:53:50.914898+0000","last_active":"2024-08-15T17:53:50.921467+0000","last_peered":"2024-08-15T17:53:50.921467+0000","last_clean":"2024-08-15T17:53:50.921467+0000","last_became_active":"2024-08-15T17:53:50.914603+0000","last_became_peered":"2024-08-15T17:53:50.914603+0000","last_unstale":"2024-08-15T17:53:50.921467+0000","last_undegraded":"2024-08-15T17:53:50.921467+0000","last_fullsized":"2024-08-15T17:53:50.921467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:11.104066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.904384+0000","last_change":"2024-08-15T17:53:50.904384+0000","last_active":"2024-08-15T17:53:50.904384+0000","last_peered":"2024-08-15T17:53:50.904384+0000","last_clean":"2024-08-15T17:53:50.904384+0000","last_became_active":"2024-08-15T17:53:50.904058+0000","last_became_peered":"2024-08-15T17:53:50.904058+0000","last_unstale":"2024-08-15T17:53:50.904384+0000","last_undegraded":"2024-08-15T17:53:50.904384+0000","last_fullsized":"2024-08-15T17:53:50.904384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921547+0000","last_change":"2024-08-15T17:53:50.914850+0000","last_active":"2024-08-15T17:53:50.921547+0000","last_peered":"2024-08-15T17:53:50.921547+0000","last_clean":"2024-08-15T17:53:50.921547+0000","last_became_active":"2024-08-15T17:53:50.914627+0000","last_became_peered":"2024-08-15T17:53:50.914627+0000","last_unstale":"2024-08-15T17:53:50.921547+0000","last_undegraded":"2024-08-15T17:53:50.921547+0000","last_fullsized":"2024-08-15T17:53:50.921547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906406+0000","last_change":"2024-08-15T17:53:50.906406+0000","last_active":"2024-08-15T17:53:50.906406+0000","last_peered":"2024-08-15T17:53:50.906406+0000","last_clean":"2024-08-15T17:53:50.906406+0000","last_became_active":"2024-08-15T17:53:50.906100+0000","last_became_peered":"2024-08-15T17:53:50.906100+0000","last_unstale":"2024-08-15T17:53:50.906406+0000","last_undegraded":"2024-08-15T17:53:50.906406+0000","last_fullsized":"2024-08-15T17:53:50.906406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:13.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905096+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.905096+0000","last_peered":"2024-08-15T17:53:50.905096+0000","last_clean":"2024-08-15T17:53:50.905096+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.905096+0000","last_undegraded":"2024-08-15T17:53:50.905096+0000","last_fullsized":"2024-08-15T17:53:50.905096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921521+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.921521+0000","last_peered":"2024-08-15T17:53:50.921521+0000","last_clean":"2024-08-15T17:53:50.921521+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.921521+0000","last_undegraded":"2024-08-15T17:53:50.921521+0000","last_fullsized":"2024-08-15T17:53:50.921521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903622+0000","last_change":"2024-08-15T17:53:50.903622+0000","last_active":"2024-08-15T17:53:50.903622+0000","last_peered":"2024-08-15T17:53:50.903622+0000","last_clean":"2024-08-15T17:53:50.903622+0000","last_became_active":"2024-08-15T17:53:50.903273+0000","last_became_peered":"2024-08-15T17:53:50.903273+0000","last_unstale":"2024-08-15T17:53:50.903622+0000","last_undegraded":"2024-08-15T17:53:50.903622+0000","last_fullsized":"2024-08-15T17:53:50.903622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913949+0000","last_change":"2024-08-15T17:53:50.913949+0000","last_active":"2024-08-15T17:53:50.913949+0000","last_peered":"2024-08-15T17:53:50.913949+0000","last_clean":"2024-08-15T17:53:50.913949+0000","last_became_active":"2024-08-15T17:53:50.912318+0000","last_became_peered":"2024-08-15T17:53:50.912318+0000","last_unstale":"2024-08-15T17:53:50.913949+0000","last_undegraded":"2024-08-15T17:53:50.913949+0000","last_fullsized":"2024-08-15T17:53:50.913949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914253+0000","last_change":"2024-08-15T17:53:50.914253+0000","last_active":"2024-08-15T17:53:50.914253+0000","last_peered":"2024-08-15T17:53:50.914253+0000","last_clean":"2024-08-15T17:53:50.914253+0000","last_became_active":"2024-08-15T17:53:50.912891+0000","last_became_peered":"2024-08-15T17:53:50.912891+0000","last_unstale":"2024-08-15T17:53:50.914253+0000","last_undegraded":"2024-08-15T17:53:50.914253+0000","last_fullsized":"2024-08-15T17:53:50.914253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:46.552157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910014+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.910014+0000","last_peered":"2024-08-15T17:53:50.910014+0000","last_clean":"2024-08-15T17:53:50.910014+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.910014+0000","last_undegraded":"2024-08-15T17:53:50.910014+0000","last_fullsized":"2024-08-15T17:53:50.910014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912445+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.912445+0000","last_peered":"2024-08-15T17:53:50.912445+0000","last_clean":"2024-08-15T17:53:50.912445+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.912445+0000","last_undegraded":"2024-08-15T17:53:50.912445+0000","last_fullsized":"2024-08-15T17:53:50.912445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907943+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.907943+0000","last_peered":"2024-08-15T17:53:50.907943+0000","last_clean":"2024-08-15T17:53:50.907943+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.907943+0000","last_undegraded":"2024-08-15T17:53:50.907943+0000","last_fullsized":"2024-08-15T17:53:50.907943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918930+0000","last_change":"2024-08-15T17:53:50.918930+0000","last_active":"2024-08-15T17:53:50.918930+0000","last_peered":"2024-08-15T17:53:50.918930+0000","last_clean":"2024-08-15T17:53:50.918930+0000","last_became_active":"2024-08-15T17:53:50.918540+0000","last_became_peered":"2024-08-15T17:53:50.918540+0000","last_unstale":"2024-08-15T17:53:50.918930+0000","last_undegraded":"2024-08-15T17:53:50.918930+0000","last_fullsized":"2024-08-15T17:53:50.918930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:47:00.308854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918137+0000","last_change":"2024-08-15T17:53:50.918137+0000","last_active":"2024-08-15T17:53:50.918137+0000","last_peered":"2024-08-15T17:53:50.918137+0000","last_clean":"2024-08-15T17:53:50.918137+0000","last_became_active":"2024-08-15T17:53:50.917839+0000","last_became_peered":"2024-08-15T17:53:50.917839+0000","last_unstale":"2024-08-15T17:53:50.918137+0000","last_undegraded":"2024-08-15T17:53:50.918137+0000","last_fullsized":"2024-08-15T17:53:50.918137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:47:03.604696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903857+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.903857+0000","last_peered":"2024-08-15T17:53:50.903857+0000","last_clean":"2024-08-15T17:53:50.903857+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.903857+0000","last_undegraded":"2024-08-15T17:53:50.903857+0000","last_fullsized":"2024-08-15T17:53:50.903857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915095+0000","last_change":"2024-08-15T17:53:50.915095+0000","last_active":"2024-08-15T17:53:50.915095+0000","last_peered":"2024-08-15T17:53:50.915095+0000","last_clean":"2024-08-15T17:53:50.915095+0000","last_became_active":"2024-08-15T17:53:50.914811+0000","last_became_peered":"2024-08-15T17:53:50.914811+0000","last_unstale":"2024-08-15T17:53:50.915095+0000","last_undegraded":"2024-08-15T17:53:50.915095+0000","last_fullsized":"2024-08-15T17:53:50.915095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911317+0000","last_change":"2024-08-15T17:53:50.911317+0000","last_active":"2024-08-15T17:53:50.911317+0000","last_peered":"2024-08-15T17:53:50.911317+0000","last_clean":"2024-08-15T17:53:50.911317+0000","last_became_active":"2024-08-15T17:53:50.910983+0000","last_became_peered":"2024-08-15T17:53:50.910983+0000","last_unstale":"2024-08-15T17:53:50.911317+0000","last_undegraded":"2024-08-15T17:53:50.911317+0000","last_fullsized":"2024-08-15T17:53:50.911317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:17:53.857852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905188+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.905188+0000","last_peered":"2024-08-15T17:53:50.905188+0000","last_clean":"2024-08-15T17:53:50.905188+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.905188+0000","last_undegraded":"2024-08-15T17:53:50.905188+0000","last_fullsized":"2024-08-15T17:53:50.905188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916679+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.916679+0000","last_peered":"2024-08-15T17:53:50.916679+0000","last_clean":"2024-08-15T17:53:50.916679+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.916679+0000","last_undegraded":"2024-08-15T17:53:50.916679+0000","last_fullsized":"2024-08-15T17:53:50.916679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903300+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.903300+0000","last_peered":"2024-08-15T17:53:50.903300+0000","last_clean":"2024-08-15T17:53:50.903300+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.903300+0000","last_undegraded":"2024-08-15T17:53:50.903300+0000","last_fullsized":"2024-08-15T17:53:50.903300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.908561+0000","last_change":"2024-08-15T17:53:50.908561+0000","last_active":"2024-08-15T17:53:50.908561+0000","last_peered":"2024-08-15T17:53:50.908561+0000","last_clean":"2024-08-15T17:53:50.908561+0000","last_became_active":"2024-08-15T17:53:50.908263+0000","last_became_peered":"2024-08-15T17:53:50.908263+0000","last_unstale":"2024-08-15T17:53:50.908561+0000","last_undegraded":"2024-08-15T17:53:50.908561+0000","last_fullsized":"2024-08-15T17:53:50.908561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:07:38.806189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911467+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.911467+0000","last_peered":"2024-08-15T17:53:50.911467+0000","last_clean":"2024-08-15T17:53:50.911467+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.911467+0000","last_undegraded":"2024-08-15T17:53:50.911467+0000","last_fullsized":"2024-08-15T17:53:50.911467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925176+0000","last_change":"2024-08-15T17:53:50.921735+0000","last_active":"2024-08-15T17:53:50.925176+0000","last_peered":"2024-08-15T17:53:50.925176+0000","last_clean":"2024-08-15T17:53:50.925176+0000","last_became_active":"2024-08-15T17:53:50.921323+0000","last_became_peered":"2024-08-15T17:53:50.921323+0000","last_unstale":"2024-08-15T17:53:50.925176+0000","last_undegraded":"2024-08-15T17:53:50.925176+0000","last_fullsized":"2024-08-15T17:53:50.925176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:36.650250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913215+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.913215+0000","last_peered":"2024-08-15T17:53:50.913215+0000","last_clean":"2024-08-15T17:53:50.913215+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.913215+0000","last_undegraded":"2024-08-15T17:53:50.913215+0000","last_fullsized":"2024-08-15T17:53:50.913215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907121+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.907121+0000","last_peered":"2024-08-15T17:53:50.907121+0000","last_clean":"2024-08-15T17:53:50.907121+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.907121+0000","last_undegraded":"2024-08-15T17:53:50.907121+0000","last_fullsized":"2024-08-15T17:53:50.907121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912441+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.912441+0000","last_peered":"2024-08-15T17:53:50.912441+0000","last_clean":"2024-08-15T17:53:50.912441+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.912441+0000","last_undegraded":"2024-08-15T17:53:50.912441+0000","last_fullsized":"2024-08-15T17:53:50.912441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916828+0000","last_change":"2024-08-15T17:53:50.916828+0000","last_active":"2024-08-15T17:53:50.916828+0000","last_peered":"2024-08-15T17:53:50.916828+0000","last_clean":"2024-08-15T17:53:50.916828+0000","last_became_active":"2024-08-15T17:53:50.916514+0000","last_became_peered":"2024-08-15T17:53:50.916514+0000","last_unstale":"2024-08-15T17:53:50.916828+0000","last_undegraded":"2024-08-15T17:53:50.916828+0000","last_fullsized":"2024-08-15T17:53:50.916828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:35:47.822736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910305+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.910305+0000","last_peered":"2024-08-15T17:53:50.910305+0000","last_clean":"2024-08-15T17:53:50.910305+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.910305+0000","last_undegraded":"2024-08-15T17:53:50.910305+0000","last_fullsized":"2024-08-15T17:53:50.910305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916688+0000","last_change":"2024-08-15T17:53:50.912831+0000","last_active":"2024-08-15T17:53:50.916688+0000","last_peered":"2024-08-15T17:53:50.916688+0000","last_clean":"2024-08-15T17:53:50.916688+0000","last_became_active":"2024-08-15T17:53:50.912616+0000","last_became_peered":"2024-08-15T17:53:50.912616+0000","last_unstale":"2024-08-15T17:53:50.916688+0000","last_undegraded":"2024-08-15T17:53:50.916688+0000","last_fullsized":"2024-08-15T17:53:50.916688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912383+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.912383+0000","last_peered":"2024-08-15T17:53:50.912383+0000","last_clean":"2024-08-15T17:53:50.912383+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.912383+0000","last_undegraded":"2024-08-15T17:53:50.912383+0000","last_fullsized":"2024-08-15T17:53:50.912383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901062+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.901062+0000","last_peered":"2024-08-15T17:53:50.901062+0000","last_clean":"2024-08-15T17:53:50.901062+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.901062+0000","last_undegraded":"2024-08-15T17:53:50.901062+0000","last_fullsized":"2024-08-15T17:53:50.901062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905354+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.905354+0000","last_peered":"2024-08-15T17:53:50.905354+0000","last_clean":"2024-08-15T17:53:50.905354+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.905354+0000","last_undegraded":"2024-08-15T17:53:50.905354+0000","last_fullsized":"2024-08-15T17:53:50.905354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903663+0000","last_change":"2024-08-15T17:53:49.909777+0000","last_active":"2024-08-15T17:53:50.903663+0000","last_peered":"2024-08-15T17:53:50.903663+0000","last_clean":"2024-08-15T17:53:50.903663+0000","last_became_active":"2024-08-15T17:53:49.909444+0000","last_became_peered":"2024-08-15T17:53:49.909444+0000","last_unstale":"2024-08-15T17:53:50.903663+0000","last_undegraded":"2024-08-15T17:53:50.903663+0000","last_fullsized":"2024-08-15T17:53:50.903663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915456+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:49.915456+0000","last_peered":"2024-08-15T17:53:49.915456+0000","last_clean":"2024-08-15T17:53:49.915456+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:49.915456+0000","last_undegraded":"2024-08-15T17:53:49.915456+0000","last_fullsized":"2024-08-15T17:53:49.915456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913318+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.913318+0000","last_peered":"2024-08-15T17:53:50.913318+0000","last_clean":"2024-08-15T17:53:50.913318+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.913318+0000","last_undegraded":"2024-08-15T17:53:50.913318+0000","last_fullsized":"2024-08-15T17:53:50.913318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.908962+0000","last_change":"2024-08-15T17:53:49.905568+0000","last_active":"2024-08-15T17:53:49.908962+0000","last_peered":"2024-08-15T17:53:49.908962+0000","last_clean":"2024-08-15T17:53:49.908962+0000","last_became_active":"2024-08-15T17:53:49.905264+0000","last_became_peered":"2024-08-15T17:53:49.905264+0000","last_unstale":"2024-08-15T17:53:49.908962+0000","last_undegraded":"2024-08-15T17:53:49.908962+0000","last_fullsized":"2024-08-15T17:53:49.908962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:45.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910666+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.910666+0000","last_peered":"2024-08-15T17:53:50.910666+0000","last_clean":"2024-08-15T17:53:50.910666+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.910666+0000","last_undegraded":"2024-08-15T17:53:50.910666+0000","last_fullsized":"2024-08-15T17:53:50.910666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.908634+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:49.908634+0000","last_peered":"2024-08-15T17:53:49.908634+0000","last_clean":"2024-08-15T17:53:49.908634+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:49.908634+0000","last_undegraded":"2024-08-15T17:53:49.908634+0000","last_fullsized":"2024-08-15T17:53:49.908634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925197+0000","last_change":"2024-08-15T17:53:50.922614+0000","last_active":"2024-08-15T17:53:50.925197+0000","last_peered":"2024-08-15T17:53:50.925197+0000","last_clean":"2024-08-15T17:53:50.925197+0000","last_became_active":"2024-08-15T17:53:50.922233+0000","last_became_peered":"2024-08-15T17:53:50.922233+0000","last_unstale":"2024-08-15T17:53:50.925197+0000","last_undegraded":"2024-08-15T17:53:50.925197+0000","last_fullsized":"2024-08-15T17:53:50.925197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:41.928727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.909139+0000","last_change":"2024-08-15T17:53:49.902494+0000","last_active":"2024-08-15T17:53:49.909139+0000","last_peered":"2024-08-15T17:53:49.909139+0000","last_clean":"2024-08-15T17:53:49.909139+0000","last_became_active":"2024-08-15T17:53:49.902216+0000","last_became_peered":"2024-08-15T17:53:49.902216+0000","last_unstale":"2024-08-15T17:53:49.909139+0000","last_undegraded":"2024-08-15T17:53:49.909139+0000","last_fullsized":"2024-08-15T17:53:49.909139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905961+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.905961+0000","last_peered":"2024-08-15T17:53:50.905961+0000","last_clean":"2024-08-15T17:53:50.905961+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.905961+0000","last_undegraded":"2024-08-15T17:53:50.905961+0000","last_fullsized":"2024-08-15T17:53:50.905961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929634+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929634+0000","last_peered":"2024-08-15T17:53:50.929634+0000","last_clean":"2024-08-15T17:53:50.929634+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929634+0000","last_undegraded":"2024-08-15T17:53:50.929634+0000","last_fullsized":"2024-08-15T17:53:50.929634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.919099+0000","last_change":"2024-08-15T17:53:50.919099+0000","last_active":"2024-08-15T17:53:50.919099+0000","last_peered":"2024-08-15T17:53:50.919099+0000","last_clean":"2024-08-15T17:53:50.919099+0000","last_became_active":"2024-08-15T17:53:50.918636+0000","last_became_peered":"2024-08-15T17:53:50.918636+0000","last_unstale":"2024-08-15T17:53:50.919099+0000","last_undegraded":"2024-08-15T17:53:50.919099+0000","last_fullsized":"2024-08-15T17:53:50.919099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.937468+0000","last_change":"2024-08-15T17:53:49.901002+0000","last_active":"2024-08-15T17:53:50.937468+0000","last_peered":"2024-08-15T17:53:50.937468+0000","last_clean":"2024-08-15T17:53:50.937468+0000","last_became_active":"2024-08-15T17:53:49.900687+0000","last_became_peered":"2024-08-15T17:53:49.900687+0000","last_unstale":"2024-08-15T17:53:50.937468+0000","last_undegraded":"2024-08-15T17:53:50.937468+0000","last_fullsized":"2024-08-15T17:53:50.937468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:00:56.507072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915295+0000","last_change":"2024-08-15T17:53:50.915295+0000","last_active":"2024-08-15T17:53:50.915295+0000","last_peered":"2024-08-15T17:53:50.915295+0000","last_clean":"2024-08-15T17:53:50.915295+0000","last_became_active":"2024-08-15T17:53:50.914142+0000","last_became_peered":"2024-08-15T17:53:50.914142+0000","last_unstale":"2024-08-15T17:53:50.915295+0000","last_undegraded":"2024-08-15T17:53:50.915295+0000","last_fullsized":"2024-08-15T17:53:50.915295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:56.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928289+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928289+0000","last_peered":"2024-08-15T17:53:50.928289+0000","last_clean":"2024-08-15T17:53:50.928289+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928289+0000","last_undegraded":"2024-08-15T17:53:50.928289+0000","last_fullsized":"2024-08-15T17:53:50.928289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921696+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.921696+0000","last_peered":"2024-08-15T17:53:50.921696+0000","last_clean":"2024-08-15T17:53:50.921696+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.921696+0000","last_undegraded":"2024-08-15T17:53:50.921696+0000","last_fullsized":"2024-08-15T17:53:50.921696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907160+0000","last_change":"2024-08-15T17:53:49.902363+0000","last_active":"2024-08-15T17:53:49.907160+0000","last_peered":"2024-08-15T17:53:49.907160+0000","last_clean":"2024-08-15T17:53:49.907160+0000","last_became_active":"2024-08-15T17:53:49.902061+0000","last_became_peered":"2024-08-15T17:53:49.902061+0000","last_unstale":"2024-08-15T17:53:49.907160+0000","last_undegraded":"2024-08-15T17:53:49.907160+0000","last_fullsized":"2024-08-15T17:53:49.907160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916048+0000","last_change":"2024-08-15T17:53:50.916048+0000","last_active":"2024-08-15T17:53:50.916048+0000","last_peered":"2024-08-15T17:53:50.916048+0000","last_clean":"2024-08-15T17:53:50.916048+0000","last_became_active":"2024-08-15T17:53:50.915821+0000","last_became_peered":"2024-08-15T17:53:50.915821+0000","last_unstale":"2024-08-15T17:53:50.916048+0000","last_undegraded":"2024-08-15T17:53:50.916048+0000","last_fullsized":"2024-08-15T17:53:50.916048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:52:59.537353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.911565+0000","last_change":"2024-08-15T17:53:49.906337+0000","last_active":"2024-08-15T17:53:49.911565+0000","last_peered":"2024-08-15T17:53:49.911565+0000","last_clean":"2024-08-15T17:53:49.911565+0000","last_became_active":"2024-08-15T17:53:49.906050+0000","last_became_peered":"2024-08-15T17:53:49.906050+0000","last_unstale":"2024-08-15T17:53:49.911565+0000","last_undegraded":"2024-08-15T17:53:49.911565+0000","last_fullsized":"2024-08-15T17:53:49.911565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912426+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.912426+0000","last_peered":"2024-08-15T17:53:50.912426+0000","last_clean":"2024-08-15T17:53:50.912426+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.912426+0000","last_undegraded":"2024-08-15T17:53:50.912426+0000","last_fullsized":"2024-08-15T17:53:50.912426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935090+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935090+0000","last_peered":"2024-08-15T17:53:50.935090+0000","last_clean":"2024-08-15T17:53:50.935090+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935090+0000","last_undegraded":"2024-08-15T17:53:50.935090+0000","last_fullsized":"2024-08-15T17:53:50.935090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918891+0000","last_change":"2024-08-15T17:53:50.918891+0000","last_active":"2024-08-15T17:53:50.918891+0000","last_peered":"2024-08-15T17:53:50.918891+0000","last_clean":"2024-08-15T17:53:50.918891+0000","last_became_active":"2024-08-15T17:53:50.918558+0000","last_became_peered":"2024-08-15T17:53:50.918558+0000","last_unstale":"2024-08-15T17:53:50.918891+0000","last_undegraded":"2024-08-15T17:53:50.918891+0000","last_fullsized":"2024-08-15T17:53:50.918891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893270+0000","last_change":"2024-08-15T17:53:49.911008+0000","last_active":"2024-08-15T17:53:50.893270+0000","last_peered":"2024-08-15T17:53:50.893270+0000","last_clean":"2024-08-15T17:53:50.893270+0000","last_became_active":"2024-08-15T17:53:49.910689+0000","last_became_peered":"2024-08-15T17:53:49.910689+0000","last_unstale":"2024-08-15T17:53:50.893270+0000","last_undegraded":"2024-08-15T17:53:50.893270+0000","last_fullsized":"2024-08-15T17:53:50.893270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907379+0000","last_change":"2024-08-15T17:53:50.904230+0000","last_active":"2024-08-15T17:53:50.907379+0000","last_peered":"2024-08-15T17:53:50.907379+0000","last_clean":"2024-08-15T17:53:50.907379+0000","last_became_active":"2024-08-15T17:53:50.903601+0000","last_became_peered":"2024-08-15T17:53:50.903601+0000","last_unstale":"2024-08-15T17:53:50.907379+0000","last_undegraded":"2024-08-15T17:53:50.907379+0000","last_fullsized":"2024-08-15T17:53:50.907379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:52.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926959+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.926959+0000","last_peered":"2024-08-15T17:53:50.926959+0000","last_clean":"2024-08-15T17:53:50.926959+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.926959+0000","last_undegraded":"2024-08-15T17:53:50.926959+0000","last_fullsized":"2024-08-15T17:53:50.926959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913859+0000","last_change":"2024-08-15T17:53:50.913859+0000","last_active":"2024-08-15T17:53:50.913859+0000","last_peered":"2024-08-15T17:53:50.913859+0000","last_clean":"2024-08-15T17:53:50.913859+0000","last_became_active":"2024-08-15T17:53:50.912444+0000","last_became_peered":"2024-08-15T17:53:50.912444+0000","last_unstale":"2024-08-15T17:53:50.913859+0000","last_undegraded":"2024-08-15T17:53:50.913859+0000","last_fullsized":"2024-08-15T17:53:50.913859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901201+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.901201+0000","last_peered":"2024-08-15T17:53:50.901201+0000","last_clean":"2024-08-15T17:53:50.901201+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.901201+0000","last_undegraded":"2024-08-15T17:53:50.901201+0000","last_fullsized":"2024-08-15T17:53:50.901201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907476+0000","last_change":"2024-08-15T17:53:50.907476+0000","last_active":"2024-08-15T17:53:50.907476+0000","last_peered":"2024-08-15T17:53:50.907476+0000","last_clean":"2024-08-15T17:53:50.907476+0000","last_became_active":"2024-08-15T17:53:50.907146+0000","last_became_peered":"2024-08-15T17:53:50.907146+0000","last_unstale":"2024-08-15T17:53:50.907476+0000","last_undegraded":"2024-08-15T17:53:50.907476+0000","last_fullsized":"2024-08-15T17:53:50.907476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:32:00.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915462+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:49.915462+0000","last_peered":"2024-08-15T17:53:49.915462+0000","last_clean":"2024-08-15T17:53:49.915462+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:49.915462+0000","last_undegraded":"2024-08-15T17:53:49.915462+0000","last_fullsized":"2024-08-15T17:53:49.915462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911334+0000","last_change":"2024-08-15T17:53:50.911334+0000","last_active":"2024-08-15T17:53:50.911334+0000","last_peered":"2024-08-15T17:53:50.911334+0000","last_clean":"2024-08-15T17:53:50.911334+0000","last_became_active":"2024-08-15T17:53:50.911063+0000","last_became_peered":"2024-08-15T17:53:50.911063+0000","last_unstale":"2024-08-15T17:53:50.911334+0000","last_undegraded":"2024-08-15T17:53:50.911334+0000","last_fullsized":"2024-08-15T17:53:50.911334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:43:02.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.896396+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:49.896396+0000","last_peered":"2024-08-15T17:53:49.896396+0000","last_clean":"2024-08-15T17:53:49.896396+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:49.896396+0000","last_undegraded":"2024-08-15T17:53:49.896396+0000","last_fullsized":"2024-08-15T17:53:49.896396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907296+0000","last_change":"2024-08-15T17:53:49.903821+0000","last_active":"2024-08-15T17:53:49.907296+0000","last_peered":"2024-08-15T17:53:49.907296+0000","last_clean":"2024-08-15T17:53:49.907296+0000","last_became_active":"2024-08-15T17:53:49.903160+0000","last_became_peered":"2024-08-15T17:53:49.903160+0000","last_unstale":"2024-08-15T17:53:49.907296+0000","last_undegraded":"2024-08-15T17:53:49.907296+0000","last_fullsized":"2024-08-15T17:53:49.907296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:15.247369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905075+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.905075+0000","last_peered":"2024-08-15T17:53:50.905075+0000","last_clean":"2024-08-15T17:53:50.905075+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.905075+0000","last_undegraded":"2024-08-15T17:53:50.905075+0000","last_fullsized":"2024-08-15T17:53:50.905075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.912813+0000","last_change":"2024-08-15T17:53:49.911873+0000","last_active":"2024-08-15T17:53:49.912813+0000","last_peered":"2024-08-15T17:53:49.912813+0000","last_clean":"2024-08-15T17:53:49.912813+0000","last_became_active":"2024-08-15T17:53:49.911498+0000","last_became_peered":"2024-08-15T17:53:49.911498+0000","last_unstale":"2024-08-15T17:53:49.912813+0000","last_undegraded":"2024-08-15T17:53:49.912813+0000","last_fullsized":"2024-08-15T17:53:49.912813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906668+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.906668+0000","last_peered":"2024-08-15T17:53:50.906668+0000","last_clean":"2024-08-15T17:53:50.906668+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906668+0000","last_undegraded":"2024-08-15T17:53:50.906668+0000","last_fullsized":"2024-08-15T17:53:50.906668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915216+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:49.915216+0000","last_peered":"2024-08-15T17:53:49.915216+0000","last_clean":"2024-08-15T17:53:49.915216+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:49.915216+0000","last_undegraded":"2024-08-15T17:53:49.915216+0000","last_fullsized":"2024-08-15T17:53:49.915216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913148+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.913148+0000","last_peered":"2024-08-15T17:53:50.913148+0000","last_clean":"2024-08-15T17:53:50.913148+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.913148+0000","last_undegraded":"2024-08-15T17:53:50.913148+0000","last_fullsized":"2024-08-15T17:53:50.913148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907139+0000","last_change":"2024-08-15T17:53:49.902223+0000","last_active":"2024-08-15T17:53:49.907139+0000","last_peered":"2024-08-15T17:53:49.907139+0000","last_clean":"2024-08-15T17:53:49.907139+0000","last_became_active":"2024-08-15T17:53:49.901891+0000","last_became_peered":"2024-08-15T17:53:49.901891+0000","last_unstale":"2024-08-15T17:53:49.907139+0000","last_undegraded":"2024-08-15T17:53:49.907139+0000","last_fullsized":"2024-08-15T17:53:49.907139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:35.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903676+0000","last_change":"2024-08-15T17:53:50.903676+0000","last_active":"2024-08-15T17:53:50.903676+0000","last_peered":"2024-08-15T17:53:50.903676+0000","last_clean":"2024-08-15T17:53:50.903676+0000","last_became_active":"2024-08-15T17:53:50.903374+0000","last_became_peered":"2024-08-15T17:53:50.903374+0000","last_unstale":"2024-08-15T17:53:50.903676+0000","last_undegraded":"2024-08-15T17:53:50.903676+0000","last_fullsized":"2024-08-15T17:53:50.903676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917918+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:49.917918+0000","last_peered":"2024-08-15T17:53:49.917918+0000","last_clean":"2024-08-15T17:53:49.917918+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:49.917918+0000","last_undegraded":"2024-08-15T17:53:49.917918+0000","last_fullsized":"2024-08-15T17:53:49.917918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916594+0000","last_change":"2024-08-15T17:53:50.909590+0000","last_active":"2024-08-15T17:53:50.916594+0000","last_peered":"2024-08-15T17:53:50.916594+0000","last_clean":"2024-08-15T17:53:50.916594+0000","last_became_active":"2024-08-15T17:53:50.908589+0000","last_became_peered":"2024-08-15T17:53:50.908589+0000","last_unstale":"2024-08-15T17:53:50.916594+0000","last_undegraded":"2024-08-15T17:53:50.916594+0000","last_fullsized":"2024-08-15T17:53:50.916594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:37.384281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907189+0000","last_change":"2024-08-15T17:53:49.902247+0000","last_active":"2024-08-15T17:53:49.907189+0000","last_peered":"2024-08-15T17:53:49.907189+0000","last_clean":"2024-08-15T17:53:49.907189+0000","last_became_active":"2024-08-15T17:53:49.901925+0000","last_became_peered":"2024-08-15T17:53:49.901925+0000","last_unstale":"2024-08-15T17:53:49.907189+0000","last_undegraded":"2024-08-15T17:53:49.907189+0000","last_fullsized":"2024-08-15T17:53:49.907189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907678+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.907678+0000","last_peered":"2024-08-15T17:53:50.907678+0000","last_clean":"2024-08-15T17:53:50.907678+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.907678+0000","last_undegraded":"2024-08-15T17:53:50.907678+0000","last_fullsized":"2024-08-15T17:53:50.907678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917817+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:49.917817+0000","last_peered":"2024-08-15T17:53:49.917817+0000","last_clean":"2024-08-15T17:53:49.917817+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:49.917817+0000","last_undegraded":"2024-08-15T17:53:49.917817+0000","last_fullsized":"2024-08-15T17:53:49.917817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906946+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.906946+0000","last_peered":"2024-08-15T17:53:50.906946+0000","last_clean":"2024-08-15T17:53:50.906946+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906946+0000","last_undegraded":"2024-08-15T17:53:50.906946+0000","last_fullsized":"2024-08-15T17:53:50.906946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932432+0000","last_change":"2024-08-15T17:53:49.909938+0000","last_active":"2024-08-15T17:53:50.932432+0000","last_peered":"2024-08-15T17:53:50.932432+0000","last_clean":"2024-08-15T17:53:50.932432+0000","last_became_active":"2024-08-15T17:53:49.909683+0000","last_became_peered":"2024-08-15T17:53:49.909683+0000","last_unstale":"2024-08-15T17:53:50.932432+0000","last_undegraded":"2024-08-15T17:53:50.932432+0000","last_fullsized":"2024-08-15T17:53:50.932432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:40.919685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907271+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.907271+0000","last_peered":"2024-08-15T17:53:50.907271+0000","last_clean":"2024-08-15T17:53:50.907271+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.907271+0000","last_undegraded":"2024-08-15T17:53:50.907271+0000","last_fullsized":"2024-08-15T17:53:50.907271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.911667+0000","last_change":"2024-08-15T17:53:49.906864+0000","last_active":"2024-08-15T17:53:49.911667+0000","last_peered":"2024-08-15T17:53:49.911667+0000","last_clean":"2024-08-15T17:53:49.911667+0000","last_became_active":"2024-08-15T17:53:49.906562+0000","last_became_peered":"2024-08-15T17:53:49.906562+0000","last_unstale":"2024-08-15T17:53:49.911667+0000","last_undegraded":"2024-08-15T17:53:49.911667+0000","last_fullsized":"2024-08-15T17:53:49.911667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914663+0000","last_change":"2024-08-15T17:53:50.914663+0000","last_active":"2024-08-15T17:53:50.914663+0000","last_peered":"2024-08-15T17:53:50.914663+0000","last_clean":"2024-08-15T17:53:50.914663+0000","last_became_active":"2024-08-15T17:53:50.914323+0000","last_became_peered":"2024-08-15T17:53:50.914323+0000","last_unstale":"2024-08-15T17:53:50.914663+0000","last_undegraded":"2024-08-15T17:53:50.914663+0000","last_fullsized":"2024-08-15T17:53:50.914663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915065+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:49.915065+0000","last_peered":"2024-08-15T17:53:49.915065+0000","last_clean":"2024-08-15T17:53:49.915065+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:49.915065+0000","last_undegraded":"2024-08-15T17:53:49.915065+0000","last_fullsized":"2024-08-15T17:53:49.915065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907755+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.907755+0000","last_peered":"2024-08-15T17:53:50.907755+0000","last_clean":"2024-08-15T17:53:50.907755+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.907755+0000","last_undegraded":"2024-08-15T17:53:50.907755+0000","last_fullsized":"2024-08-15T17:53:50.907755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915510+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:49.915510+0000","last_peered":"2024-08-15T17:53:49.915510+0000","last_clean":"2024-08-15T17:53:49.915510+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:49.915510+0000","last_undegraded":"2024-08-15T17:53:49.915510+0000","last_fullsized":"2024-08-15T17:53:49.915510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910580+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.910580+0000","last_peered":"2024-08-15T17:53:50.910580+0000","last_clean":"2024-08-15T17:53:50.910580+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.910580+0000","last_undegraded":"2024-08-15T17:53:50.910580+0000","last_fullsized":"2024-08-15T17:53:50.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.930100+0000","last_change":"2024-08-15T17:53:49.903999+0000","last_active":"2024-08-15T17:53:50.930100+0000","last_peered":"2024-08-15T17:53:50.930100+0000","last_clean":"2024-08-15T17:53:50.930100+0000","last_became_active":"2024-08-15T17:53:49.903565+0000","last_became_peered":"2024-08-15T17:53:49.903565+0000","last_unstale":"2024-08-15T17:53:50.930100+0000","last_undegraded":"2024-08-15T17:53:50.930100+0000","last_fullsized":"2024-08-15T17:53:50.930100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:04:25.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918330+0000","last_change":"2024-08-15T17:53:50.918330+0000","last_active":"2024-08-15T17:53:50.918330+0000","last_peered":"2024-08-15T17:53:50.918330+0000","last_clean":"2024-08-15T17:53:50.918330+0000","last_became_active":"2024-08-15T17:53:50.917987+0000","last_became_peered":"2024-08-15T17:53:50.917987+0000","last_unstale":"2024-08-15T17:53:50.918330+0000","last_undegraded":"2024-08-15T17:53:50.918330+0000","last_fullsized":"2024-08-15T17:53:50.918330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:58:12.793849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909037+0000","last_change":"2024-08-15T17:53:50.909037+0000","last_active":"2024-08-15T17:53:50.909037+0000","last_peered":"2024-08-15T17:53:50.909037+0000","last_clean":"2024-08-15T17:53:50.909037+0000","last_became_active":"2024-08-15T17:53:50.908705+0000","last_became_peered":"2024-08-15T17:53:50.908705+0000","last_unstale":"2024-08-15T17:53:50.909037+0000","last_undegraded":"2024-08-15T17:53:50.909037+0000","last_fullsized":"2024-08-15T17:53:50.909037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:50:09.164360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928060+0000","last_change":"2024-08-15T17:53:49.902233+0000","last_active":"2024-08-15T17:53:50.928060+0000","last_peered":"2024-08-15T17:53:50.928060+0000","last_clean":"2024-08-15T17:53:50.928060+0000","last_became_active":"2024-08-15T17:53:49.901894+0000","last_became_peered":"2024-08-15T17:53:49.901894+0000","last_unstale":"2024-08-15T17:53:50.928060+0000","last_undegraded":"2024-08-15T17:53:50.928060+0000","last_fullsized":"2024-08-15T17:53:50.928060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913554+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.913554+0000","last_peered":"2024-08-15T17:53:50.913554+0000","last_clean":"2024-08-15T17:53:50.913554+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.913554+0000","last_undegraded":"2024-08-15T17:53:50.913554+0000","last_fullsized":"2024-08-15T17:53:50.913554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927981+0000","last_change":"2024-08-15T17:53:49.902248+0000","last_active":"2024-08-15T17:53:50.927981+0000","last_peered":"2024-08-15T17:53:50.927981+0000","last_clean":"2024-08-15T17:53:50.927981+0000","last_became_active":"2024-08-15T17:53:49.901911+0000","last_became_peered":"2024-08-15T17:53:49.901911+0000","last_unstale":"2024-08-15T17:53:50.927981+0000","last_undegraded":"2024-08-15T17:53:50.927981+0000","last_fullsized":"2024-08-15T17:53:50.927981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910641+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.910641+0000","last_peered":"2024-08-15T17:53:50.910641+0000","last_clean":"2024-08-15T17:53:50.910641+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.910641+0000","last_undegraded":"2024-08-15T17:53:50.910641+0000","last_fullsized":"2024-08-15T17:53:50.910641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901431+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.901431+0000","last_peered":"2024-08-15T17:53:50.901431+0000","last_clean":"2024-08-15T17:53:50.901431+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.901431+0000","last_undegraded":"2024-08-15T17:53:50.901431+0000","last_fullsized":"2024-08-15T17:53:50.901431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.908002+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.908002+0000","last_peered":"2024-08-15T17:53:50.908002+0000","last_clean":"2024-08-15T17:53:50.908002+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.908002+0000","last_undegraded":"2024-08-15T17:53:50.908002+0000","last_fullsized":"2024-08-15T17:53:50.908002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927882+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.927882+0000","last_peered":"2024-08-15T17:53:50.927882+0000","last_clean":"2024-08-15T17:53:50.927882+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.927882+0000","last_undegraded":"2024-08-15T17:53:50.927882+0000","last_fullsized":"2024-08-15T17:53:50.927882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":200704,"data_stored":67157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":68139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":66643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":66711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":184320,"data_stored":59824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":798720,"data_stored":657047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":68799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":794624,"data_stored":657025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:53:54.583 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-15T17:53:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 Processor -- start 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- start start 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bb40b0d20 0x7f7bb406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb406e450 0x7f7bb40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bb40b1630 0x7f7bb41610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb4141a00 con 0x7f7bb40b1630 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb406e8a0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4140b10 con 0x7f7bb406e450 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb2d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bb40b1630 0x7f7bb41610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb1d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb406e450 0x7f7bb40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bb40b0d20 0x7f7bb406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb2d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bb40b1630 0x7f7bb41610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38484/0 (socket says 172.21.15.33:38484) 2024-08-15T17:53:54.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb1d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb406e450 0x7f7bb40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:53482/0 (socket says 172.21.15.33:53482) 2024-08-15T17:53:54.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb2d9d700 1 -- 172.21.15.33:0/4258319639 learned_addr learned my addr 172.21.15.33:0/4258319639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 -- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb406e450 msgr2=0x7f7bb40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 --2- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb406e450 0x7f7bb40b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 -- 172.21.15.33:0/4258319639 >> v2:172.21.15.33:3300/0 conn(0x7f7bb40b1630 msgr2=0x7f7bb41610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 --2- 172.21.15.33:0/4258319639 >> v2:172.21.15.33:3300/0 conn(0x7f7bb40b1630 0x7f7bb41610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 -- 172.21.15.33:0/4258319639 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4140df0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb259c700 1 --2- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40b0d20 0x7f7bb406df10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406bd20 tx=0x7f7b9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5556bc7a0f52d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb159a700 1 -- 172.21.15.33:0/4258319639 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011630 con 0x7f7bb40b0d20 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb159a700 1 -- 172.21.15.33:0/4258319639 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0117b0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb159a700 1 -- 172.21.15.33:0/4258319639 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011b70 con 0x7f7bb40b0d20 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40b0d20 msgr2=0x7f7bb406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40b0d20 0x7f7bb406df10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406bd20 tx=0x7f7b9c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- 172.21.15.33:0/4258319639 shutdown_connections 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- 172.21.15.33:0/4258319639 >> v2:172.21.15.33:3300/0 conn(0x7f7bb40b1630 0x7f7bb41610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb406e450 0x7f7bb40b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 --2- 172.21.15.33:0/4258319639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40b0d20 0x7f7bb406df10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- 172.21.15.33:0/4258319639 >> 172.21.15.33:0/4258319639 conn(0x7f7bb40678d0 msgr2=0x7f7bb4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- 172.21.15.33:0/4258319639 shutdown_connections 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.695+0000 7f7bb359e700 1 -- 172.21.15.33:0/4258319639 wait complete. 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 Processor -- start 2024-08-15T17:53:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 -- start start 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb406e450 0x7f7bb4159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 0x7f7bb4145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb40b1630 0x7f7bb41463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41355f0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41349e0 con 0x7f7bb406e450 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4134cc0 con 0x7f7bb40b1630 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 0x7f7bb4145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 0x7f7bb4145e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38492/0 (socket says 172.21.15.33:38492) 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb1d9b700 1 -- 172.21.15.33:0/3369867017 learned_addr learned my addr 172.21.15.33:0/3369867017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb259c700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb406e450 0x7f7bb4159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.699+0000 7f7bb2d9d700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb40b1630 0x7f7bb41463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb1d9b700 1 -- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb40b1630 msgr2=0x7f7bb41463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb1d9b700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb40b1630 0x7f7bb41463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb1d9b700 1 -- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb406e450 msgr2=0x7f7bb4159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb1d9b700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb406e450 0x7f7bb4159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb1d9b700 1 -- 172.21.15.33:0/3369867017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c009420 con 0x7f7bb40b0d20 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb259c700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb406e450 0x7f7bb4159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb1d9b700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 0x7f7bb4145e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009e50 tx=0x7f7bac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00caa0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac00f040 con 0x7f7bb40b0d20 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb4134fa0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00ce30 con 0x7f7bb40b0d20 2024-08-15T17:53:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb415a020 con 0x7f7bb40b0d20 2024-08-15T17:53:54.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb41357a0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.703+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7bac014690 con 0x7f7bb40b0d20 2024-08-15T17:53:54.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.707+0000 7f7baa7fc700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7b94060860 0x7f7b94062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:54.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.707+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bac07d790 con 0x7f7bb40b0d20 2024-08-15T17:53:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.707+0000 7f7bb259c700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7b94060860 0x7f7b94062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.707+0000 7f7bb259c700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7b94060860 0x7f7b94062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406bd20 tx=0x7f7b9c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:54.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.711+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7bb41357a0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7bb4135420 con 0x7f7bb40b0d20 2024-08-15T17:53:54.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7baa7fc700 1 -- 172.21.15.33:0/3369867017 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1013 (secure 0 0 0) 0x7f7bac0515d0 con 0x7f7bb40b0d20 2024-08-15T17:53:54.940 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:54.940 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1723744416,"num_in_osds":8,"osd_in_since":1723744407,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592706,"bytes_used":2443026432,"bytes_avail":770651086848,"bytes_total":773094113280,"write_bytes_sec":2480,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-08-15T17:53:25.909391+0000","services":{}},"progress_events":{}} 2024-08-15T17:53:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7b94060860 msgr2=0x7f7b94062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7b94060860 0x7f7b94062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406bd20 tx=0x7f7b9c017000 comp rx=0 tx=0).stop 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 msgr2=0x7f7bb4145e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 0x7f7bb4145e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009e50 tx=0x7f7bac00b040 comp rx=0 tx=0).stop 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 shutdown_connections 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7b94060860 0x7f7b94062d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb40b1630 0x7f7bb41463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bb40b0d20 0x7f7bb4145e90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 --2- 172.21.15.33:0/3369867017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb406e450 0x7f7bb4159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 >> 172.21.15.33:0/3369867017 conn(0x7f7bb40678d0 msgr2=0x7f7bb415cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 shutdown_connections 2024-08-15T17:53:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:54.939+0000 7f7bb359e700 1 -- 172.21.15.33:0/3369867017 wait complete. 2024-08-15T17:53:54.957 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-15T17:53:54.957 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:53:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.063+0000 7fbbdf548700 1 Processor -- start 2024-08-15T17:53:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.063+0000 7fbbdf548700 1 -- start start 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbbd80688d0 0x7fbbd8068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd80cc160 0x7fbbd80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80c7750 con 0x7fbbd806a470 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80cb220 con 0x7fbbd80688d0 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80caf80 con 0x7fbbd80cc160 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbbd80688d0 0x7fbbd8068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbbd80688d0 0x7fbbd8068ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38500/0 (socket says 172.21.15.33:38500) 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 -- 172.21.15.33:0/464146188 learned_addr learned my addr 172.21.15.33:0/464146188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbddae5700 1 --1- 172.21.15.33:0/464146188 >> v1:172.21.15.33:6789/0 conn(0x7fbbd806a470 0x7fbbd80c7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59156/0 (socket says 172.21.15.33:59156) 2024-08-15T17:53:55.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdcae3700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd80cc160 0x7fbbd80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:55.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 -- 172.21.15.33:0/464146188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd80cc160 msgr2=0x7fbbd80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:55.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd80cc160 0x7fbbd80caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 -- 172.21.15.33:0/464146188 >> v1:172.21.15.33:6789/0 conn(0x7fbbd806a470 legacy=0x7fbbd80c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:55.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 -- 172.21.15.33:0/464146188 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80c6e20 con 0x7fbbd80688d0 2024-08-15T17:53:55.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdcae3700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd80cc160 0x7fbbd80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:53:55.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdd2e4700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80688d0 0x7fbbd8068ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400ab50 tx=0x7fbbd400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20139a3f4dc0720 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:55.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbcffff700 1 -- 172.21.15.33:0/464146188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd400ca00 con 0x7fbbd80688d0 2024-08-15T17:53:55.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbcffff700 1 -- 172.21.15.33:0/464146188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd400cb60 con 0x7fbbd80688d0 2024-08-15T17:53:55.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbcffff700 1 -- 172.21.15.33:0/464146188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd400f470 con 0x7fbbd80688d0 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- 172.21.15.33:0/464146188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80688d0 msgr2=0x7fbbd8068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80688d0 0x7fbbd8068ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400ab50 tx=0x7fbbd400a3f0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- 172.21.15.33:0/464146188 shutdown_connections 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd80cc160 0x7fbbd80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 --2- 172.21.15.33:0/464146188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80688d0 0x7fbbd8068ca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- 172.21.15.33:0/464146188 >> 172.21.15.33:0/464146188 conn(0x7fbbd80c9c20 msgr2=0x7fbbd806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- 172.21.15.33:0/464146188 shutdown_connections 2024-08-15T17:53:55.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.067+0000 7fbbdf548700 1 -- 172.21.15.33:0/464146188 wait complete. 2024-08-15T17:53:55.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 Processor -- start 2024-08-15T17:53:55.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 -- start start 2024-08-15T17:53:55.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd80688d0 0x7fbbd81653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:55.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd806a470 0x7fbbd8169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:55.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 0x7fbbd80c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:55.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd81663f0 con 0x7fbbd80cc160 2024-08-15T17:53:55.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80acb00 con 0x7fbbd80688d0 2024-08-15T17:53:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdf548700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8165e30 con 0x7fbbd806a470 2024-08-15T17:53:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbddae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 0x7fbbd80c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbddae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 0x7fbbd80c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38512/0 (socket says 172.21.15.33:38512) 2024-08-15T17:53:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbddae5700 1 -- 172.21.15.33:0/3045402013 learned_addr learned my addr 172.21.15.33:0/3045402013 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdd2e4700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd80688d0 0x7fbbd81653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.071+0000 7fbbdcae3700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd806a470 0x7fbbd8169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:55.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbddae5700 1 -- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd806a470 msgr2=0x7fbbd8169120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:55.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbddae5700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd806a470 0x7fbbd8169120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbddae5700 1 -- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd80688d0 msgr2=0x7fbbd81653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:55.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbddae5700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd80688d0 0x7fbbd81653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbddae5700 1 -- 172.21.15.33:0/3045402013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd400a690 con 0x7fbbd80cc160 2024-08-15T17:53:55.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbdcae3700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd806a470 0x7fbbd8169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:55.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbddae5700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 0x7fbbd80c36f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000cd30 tx=0x7fbbd0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:55.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000ce90 con 0x7fbbd80cc160 2024-08-15T17:53:55.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0005df0 con 0x7fbbd80cc160 2024-08-15T17:53:55.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd8166110 con 0x7fbbd80cc160 2024-08-15T17:53:55.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000ab70 con 0x7fbbd80cc160 2024-08-15T17:53:55.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd80afdc0 con 0x7fbbd80cc160 2024-08-15T17:53:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbbd00070f0 con 0x7fbbd80cc160 2024-08-15T17:53:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.075+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd80acc90 con 0x7fbbd80cc160 2024-08-15T17:53:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.079+0000 7fbbcd7fa700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.079+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbd007cd20 con 0x7fbbd80cc160 2024-08-15T17:53:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.079+0000 7fbbdd2e4700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.079+0000 7fbbdd2e4700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400ab50 tx=0x7fbbd4019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:55.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.083+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbbd004d150 con 0x7fbbd80cc160 2024-08-15T17:53:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.247+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbd80645c0 con 0x7fbbbc060860 2024-08-15T17:53:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.263+0000 7fbbcd7fa700 1 -- 172.21.15.33:0/3045402013 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264567 (secure 0 0 0) 0x7fbbd80645c0 con 0x7fbbbc060860 2024-08-15T17:53:55.267 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 msgr2=0x7fbbbc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400ab50 tx=0x7fbbd4019000 comp rx=0 tx=0).stop 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 msgr2=0x7fbbd80c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 0x7fbbd80c36f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000cd30 tx=0x7fbbd0001b10 comp rx=0 tx=0).stop 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 shutdown_connections 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbbbc060860 0x7fbbbc062d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd80cc160 0x7fbbd80c36f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbd806a470 0x7fbbd8169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 --2- 172.21.15.33:0/3045402013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbd80688d0 0x7fbbd81653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 >> 172.21.15.33:0/3045402013 conn(0x7fbbd80c9c20 msgr2=0x7fbbd80cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 shutdown_connections 2024-08-15T17:53:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:55.267+0000 7fbbdf548700 1 -- 172.21.15.33:0/3045402013 wait complete. 2024-08-15T17:53:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:53:55.282 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-15T17:53:54.238384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385768,"kb_used_data":2748,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588952,"statfs":{"total":773094113280,"available":770651086848,"internally_reserved":0,"allocated":2813952,"data_stored":1711345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.365947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914055+0000","last_change":"2024-08-15T17:53:50.914055+0000","last_active":"2024-08-15T17:53:50.914055+0000","last_peered":"2024-08-15T17:53:50.914055+0000","last_clean":"2024-08-15T17:53:50.914055+0000","last_became_active":"2024-08-15T17:53:50.912515+0000","last_became_peered":"2024-08-15T17:53:50.912515+0000","last_unstale":"2024-08-15T17:53:50.914055+0000","last_undegraded":"2024-08-15T17:53:50.914055+0000","last_fullsized":"2024-08-15T17:53:50.914055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911772+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.911772+0000","last_peered":"2024-08-15T17:53:50.911772+0000","last_clean":"2024-08-15T17:53:50.911772+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.911772+0000","last_undegraded":"2024-08-15T17:53:50.911772+0000","last_fullsized":"2024-08-15T17:53:50.911772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915015+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.915015+0000","last_peered":"2024-08-15T17:53:50.915015+0000","last_clean":"2024-08-15T17:53:50.915015+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.915015+0000","last_undegraded":"2024-08-15T17:53:50.915015+0000","last_fullsized":"2024-08-15T17:53:50.915015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921467+0000","last_change":"2024-08-15T17:53:50.914898+0000","last_active":"2024-08-15T17:53:50.921467+0000","last_peered":"2024-08-15T17:53:50.921467+0000","last_clean":"2024-08-15T17:53:50.921467+0000","last_became_active":"2024-08-15T17:53:50.914603+0000","last_became_peered":"2024-08-15T17:53:50.914603+0000","last_unstale":"2024-08-15T17:53:50.921467+0000","last_undegraded":"2024-08-15T17:53:50.921467+0000","last_fullsized":"2024-08-15T17:53:50.921467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:11.104066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.904384+0000","last_change":"2024-08-15T17:53:50.904384+0000","last_active":"2024-08-15T17:53:50.904384+0000","last_peered":"2024-08-15T17:53:50.904384+0000","last_clean":"2024-08-15T17:53:50.904384+0000","last_became_active":"2024-08-15T17:53:50.904058+0000","last_became_peered":"2024-08-15T17:53:50.904058+0000","last_unstale":"2024-08-15T17:53:50.904384+0000","last_undegraded":"2024-08-15T17:53:50.904384+0000","last_fullsized":"2024-08-15T17:53:50.904384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921547+0000","last_change":"2024-08-15T17:53:50.914850+0000","last_active":"2024-08-15T17:53:50.921547+0000","last_peered":"2024-08-15T17:53:50.921547+0000","last_clean":"2024-08-15T17:53:50.921547+0000","last_became_active":"2024-08-15T17:53:50.914627+0000","last_became_peered":"2024-08-15T17:53:50.914627+0000","last_unstale":"2024-08-15T17:53:50.921547+0000","last_undegraded":"2024-08-15T17:53:50.921547+0000","last_fullsized":"2024-08-15T17:53:50.921547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906406+0000","last_change":"2024-08-15T17:53:50.906406+0000","last_active":"2024-08-15T17:53:50.906406+0000","last_peered":"2024-08-15T17:53:50.906406+0000","last_clean":"2024-08-15T17:53:50.906406+0000","last_became_active":"2024-08-15T17:53:50.906100+0000","last_became_peered":"2024-08-15T17:53:50.906100+0000","last_unstale":"2024-08-15T17:53:50.906406+0000","last_undegraded":"2024-08-15T17:53:50.906406+0000","last_fullsized":"2024-08-15T17:53:50.906406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:13.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905096+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.905096+0000","last_peered":"2024-08-15T17:53:50.905096+0000","last_clean":"2024-08-15T17:53:50.905096+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.905096+0000","last_undegraded":"2024-08-15T17:53:50.905096+0000","last_fullsized":"2024-08-15T17:53:50.905096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921521+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.921521+0000","last_peered":"2024-08-15T17:53:50.921521+0000","last_clean":"2024-08-15T17:53:50.921521+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.921521+0000","last_undegraded":"2024-08-15T17:53:50.921521+0000","last_fullsized":"2024-08-15T17:53:50.921521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903622+0000","last_change":"2024-08-15T17:53:50.903622+0000","last_active":"2024-08-15T17:53:50.903622+0000","last_peered":"2024-08-15T17:53:50.903622+0000","last_clean":"2024-08-15T17:53:50.903622+0000","last_became_active":"2024-08-15T17:53:50.903273+0000","last_became_peered":"2024-08-15T17:53:50.903273+0000","last_unstale":"2024-08-15T17:53:50.903622+0000","last_undegraded":"2024-08-15T17:53:50.903622+0000","last_fullsized":"2024-08-15T17:53:50.903622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913949+0000","last_change":"2024-08-15T17:53:50.913949+0000","last_active":"2024-08-15T17:53:50.913949+0000","last_peered":"2024-08-15T17:53:50.913949+0000","last_clean":"2024-08-15T17:53:50.913949+0000","last_became_active":"2024-08-15T17:53:50.912318+0000","last_became_peered":"2024-08-15T17:53:50.912318+0000","last_unstale":"2024-08-15T17:53:50.913949+0000","last_undegraded":"2024-08-15T17:53:50.913949+0000","last_fullsized":"2024-08-15T17:53:50.913949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914253+0000","last_change":"2024-08-15T17:53:50.914253+0000","last_active":"2024-08-15T17:53:50.914253+0000","last_peered":"2024-08-15T17:53:50.914253+0000","last_clean":"2024-08-15T17:53:50.914253+0000","last_became_active":"2024-08-15T17:53:50.912891+0000","last_became_peered":"2024-08-15T17:53:50.912891+0000","last_unstale":"2024-08-15T17:53:50.914253+0000","last_undegraded":"2024-08-15T17:53:50.914253+0000","last_fullsized":"2024-08-15T17:53:50.914253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:46.552157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910014+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.910014+0000","last_peered":"2024-08-15T17:53:50.910014+0000","last_clean":"2024-08-15T17:53:50.910014+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.910014+0000","last_undegraded":"2024-08-15T17:53:50.910014+0000","last_fullsized":"2024-08-15T17:53:50.910014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912445+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.912445+0000","last_peered":"2024-08-15T17:53:50.912445+0000","last_clean":"2024-08-15T17:53:50.912445+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.912445+0000","last_undegraded":"2024-08-15T17:53:50.912445+0000","last_fullsized":"2024-08-15T17:53:50.912445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907943+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.907943+0000","last_peered":"2024-08-15T17:53:50.907943+0000","last_clean":"2024-08-15T17:53:50.907943+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.907943+0000","last_undegraded":"2024-08-15T17:53:50.907943+0000","last_fullsized":"2024-08-15T17:53:50.907943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918930+0000","last_change":"2024-08-15T17:53:50.918930+0000","last_active":"2024-08-15T17:53:50.918930+0000","last_peered":"2024-08-15T17:53:50.918930+0000","last_clean":"2024-08-15T17:53:50.918930+0000","last_became_active":"2024-08-15T17:53:50.918540+0000","last_became_peered":"2024-08-15T17:53:50.918540+0000","last_unstale":"2024-08-15T17:53:50.918930+0000","last_undegraded":"2024-08-15T17:53:50.918930+0000","last_fullsized":"2024-08-15T17:53:50.918930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:47:00.308854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918137+0000","last_change":"2024-08-15T17:53:50.918137+0000","last_active":"2024-08-15T17:53:50.918137+0000","last_peered":"2024-08-15T17:53:50.918137+0000","last_clean":"2024-08-15T17:53:50.918137+0000","last_became_active":"2024-08-15T17:53:50.917839+0000","last_became_peered":"2024-08-15T17:53:50.917839+0000","last_unstale":"2024-08-15T17:53:50.918137+0000","last_undegraded":"2024-08-15T17:53:50.918137+0000","last_fullsized":"2024-08-15T17:53:50.918137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:47:03.604696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903857+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.903857+0000","last_peered":"2024-08-15T17:53:50.903857+0000","last_clean":"2024-08-15T17:53:50.903857+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.903857+0000","last_undegraded":"2024-08-15T17:53:50.903857+0000","last_fullsized":"2024-08-15T17:53:50.903857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915095+0000","last_change":"2024-08-15T17:53:50.915095+0000","last_active":"2024-08-15T17:53:50.915095+0000","last_peered":"2024-08-15T17:53:50.915095+0000","last_clean":"2024-08-15T17:53:50.915095+0000","last_became_active":"2024-08-15T17:53:50.914811+0000","last_became_peered":"2024-08-15T17:53:50.914811+0000","last_unstale":"2024-08-15T17:53:50.915095+0000","last_undegraded":"2024-08-15T17:53:50.915095+0000","last_fullsized":"2024-08-15T17:53:50.915095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911317+0000","last_change":"2024-08-15T17:53:50.911317+0000","last_active":"2024-08-15T17:53:50.911317+0000","last_peered":"2024-08-15T17:53:50.911317+0000","last_clean":"2024-08-15T17:53:50.911317+0000","last_became_active":"2024-08-15T17:53:50.910983+0000","last_became_peered":"2024-08-15T17:53:50.910983+0000","last_unstale":"2024-08-15T17:53:50.911317+0000","last_undegraded":"2024-08-15T17:53:50.911317+0000","last_fullsized":"2024-08-15T17:53:50.911317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:17:53.857852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905188+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.905188+0000","last_peered":"2024-08-15T17:53:50.905188+0000","last_clean":"2024-08-15T17:53:50.905188+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.905188+0000","last_undegraded":"2024-08-15T17:53:50.905188+0000","last_fullsized":"2024-08-15T17:53:50.905188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916679+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.916679+0000","last_peered":"2024-08-15T17:53:50.916679+0000","last_clean":"2024-08-15T17:53:50.916679+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.916679+0000","last_undegraded":"2024-08-15T17:53:50.916679+0000","last_fullsized":"2024-08-15T17:53:50.916679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903300+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.903300+0000","last_peered":"2024-08-15T17:53:50.903300+0000","last_clean":"2024-08-15T17:53:50.903300+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.903300+0000","last_undegraded":"2024-08-15T17:53:50.903300+0000","last_fullsized":"2024-08-15T17:53:50.903300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.908561+0000","last_change":"2024-08-15T17:53:50.908561+0000","last_active":"2024-08-15T17:53:50.908561+0000","last_peered":"2024-08-15T17:53:50.908561+0000","last_clean":"2024-08-15T17:53:50.908561+0000","last_became_active":"2024-08-15T17:53:50.908263+0000","last_became_peered":"2024-08-15T17:53:50.908263+0000","last_unstale":"2024-08-15T17:53:50.908561+0000","last_undegraded":"2024-08-15T17:53:50.908561+0000","last_fullsized":"2024-08-15T17:53:50.908561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:07:38.806189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911467+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.911467+0000","last_peered":"2024-08-15T17:53:50.911467+0000","last_clean":"2024-08-15T17:53:50.911467+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.911467+0000","last_undegraded":"2024-08-15T17:53:50.911467+0000","last_fullsized":"2024-08-15T17:53:50.911467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925176+0000","last_change":"2024-08-15T17:53:50.921735+0000","last_active":"2024-08-15T17:53:50.925176+0000","last_peered":"2024-08-15T17:53:50.925176+0000","last_clean":"2024-08-15T17:53:50.925176+0000","last_became_active":"2024-08-15T17:53:50.921323+0000","last_became_peered":"2024-08-15T17:53:50.921323+0000","last_unstale":"2024-08-15T17:53:50.925176+0000","last_undegraded":"2024-08-15T17:53:50.925176+0000","last_fullsized":"2024-08-15T17:53:50.925176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:36.650250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913215+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.913215+0000","last_peered":"2024-08-15T17:53:50.913215+0000","last_clean":"2024-08-15T17:53:50.913215+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.913215+0000","last_undegraded":"2024-08-15T17:53:50.913215+0000","last_fullsized":"2024-08-15T17:53:50.913215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907121+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.907121+0000","last_peered":"2024-08-15T17:53:50.907121+0000","last_clean":"2024-08-15T17:53:50.907121+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.907121+0000","last_undegraded":"2024-08-15T17:53:50.907121+0000","last_fullsized":"2024-08-15T17:53:50.907121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912441+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.912441+0000","last_peered":"2024-08-15T17:53:50.912441+0000","last_clean":"2024-08-15T17:53:50.912441+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.912441+0000","last_undegraded":"2024-08-15T17:53:50.912441+0000","last_fullsized":"2024-08-15T17:53:50.912441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916828+0000","last_change":"2024-08-15T17:53:50.916828+0000","last_active":"2024-08-15T17:53:50.916828+0000","last_peered":"2024-08-15T17:53:50.916828+0000","last_clean":"2024-08-15T17:53:50.916828+0000","last_became_active":"2024-08-15T17:53:50.916514+0000","last_became_peered":"2024-08-15T17:53:50.916514+0000","last_unstale":"2024-08-15T17:53:50.916828+0000","last_undegraded":"2024-08-15T17:53:50.916828+0000","last_fullsized":"2024-08-15T17:53:50.916828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:35:47.822736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910305+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.910305+0000","last_peered":"2024-08-15T17:53:50.910305+0000","last_clean":"2024-08-15T17:53:50.910305+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.910305+0000","last_undegraded":"2024-08-15T17:53:50.910305+0000","last_fullsized":"2024-08-15T17:53:50.910305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916688+0000","last_change":"2024-08-15T17:53:50.912831+0000","last_active":"2024-08-15T17:53:50.916688+0000","last_peered":"2024-08-15T17:53:50.916688+0000","last_clean":"2024-08-15T17:53:50.916688+0000","last_became_active":"2024-08-15T17:53:50.912616+0000","last_became_peered":"2024-08-15T17:53:50.912616+0000","last_unstale":"2024-08-15T17:53:50.916688+0000","last_undegraded":"2024-08-15T17:53:50.916688+0000","last_fullsized":"2024-08-15T17:53:50.916688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912383+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.912383+0000","last_peered":"2024-08-15T17:53:50.912383+0000","last_clean":"2024-08-15T17:53:50.912383+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.912383+0000","last_undegraded":"2024-08-15T17:53:50.912383+0000","last_fullsized":"2024-08-15T17:53:50.912383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901062+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.901062+0000","last_peered":"2024-08-15T17:53:50.901062+0000","last_clean":"2024-08-15T17:53:50.901062+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.901062+0000","last_undegraded":"2024-08-15T17:53:50.901062+0000","last_fullsized":"2024-08-15T17:53:50.901062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905354+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.905354+0000","last_peered":"2024-08-15T17:53:50.905354+0000","last_clean":"2024-08-15T17:53:50.905354+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.905354+0000","last_undegraded":"2024-08-15T17:53:50.905354+0000","last_fullsized":"2024-08-15T17:53:50.905354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903663+0000","last_change":"2024-08-15T17:53:49.909777+0000","last_active":"2024-08-15T17:53:50.903663+0000","last_peered":"2024-08-15T17:53:50.903663+0000","last_clean":"2024-08-15T17:53:50.903663+0000","last_became_active":"2024-08-15T17:53:49.909444+0000","last_became_peered":"2024-08-15T17:53:49.909444+0000","last_unstale":"2024-08-15T17:53:50.903663+0000","last_undegraded":"2024-08-15T17:53:50.903663+0000","last_fullsized":"2024-08-15T17:53:50.903663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915456+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:49.915456+0000","last_peered":"2024-08-15T17:53:49.915456+0000","last_clean":"2024-08-15T17:53:49.915456+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:49.915456+0000","last_undegraded":"2024-08-15T17:53:49.915456+0000","last_fullsized":"2024-08-15T17:53:49.915456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913318+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.913318+0000","last_peered":"2024-08-15T17:53:50.913318+0000","last_clean":"2024-08-15T17:53:50.913318+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.913318+0000","last_undegraded":"2024-08-15T17:53:50.913318+0000","last_fullsized":"2024-08-15T17:53:50.913318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.908962+0000","last_change":"2024-08-15T17:53:49.905568+0000","last_active":"2024-08-15T17:53:49.908962+0000","last_peered":"2024-08-15T17:53:49.908962+0000","last_clean":"2024-08-15T17:53:49.908962+0000","last_became_active":"2024-08-15T17:53:49.905264+0000","last_became_peered":"2024-08-15T17:53:49.905264+0000","last_unstale":"2024-08-15T17:53:49.908962+0000","last_undegraded":"2024-08-15T17:53:49.908962+0000","last_fullsized":"2024-08-15T17:53:49.908962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:45.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910666+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.910666+0000","last_peered":"2024-08-15T17:53:50.910666+0000","last_clean":"2024-08-15T17:53:50.910666+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.910666+0000","last_undegraded":"2024-08-15T17:53:50.910666+0000","last_fullsized":"2024-08-15T17:53:50.910666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.908634+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:49.908634+0000","last_peered":"2024-08-15T17:53:49.908634+0000","last_clean":"2024-08-15T17:53:49.908634+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:49.908634+0000","last_undegraded":"2024-08-15T17:53:49.908634+0000","last_fullsized":"2024-08-15T17:53:49.908634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925197+0000","last_change":"2024-08-15T17:53:50.922614+0000","last_active":"2024-08-15T17:53:50.925197+0000","last_peered":"2024-08-15T17:53:50.925197+0000","last_clean":"2024-08-15T17:53:50.925197+0000","last_became_active":"2024-08-15T17:53:50.922233+0000","last_became_peered":"2024-08-15T17:53:50.922233+0000","last_unstale":"2024-08-15T17:53:50.925197+0000","last_undegraded":"2024-08-15T17:53:50.925197+0000","last_fullsized":"2024-08-15T17:53:50.925197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:41.928727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.909139+0000","last_change":"2024-08-15T17:53:49.902494+0000","last_active":"2024-08-15T17:53:49.909139+0000","last_peered":"2024-08-15T17:53:49.909139+0000","last_clean":"2024-08-15T17:53:49.909139+0000","last_became_active":"2024-08-15T17:53:49.902216+0000","last_became_peered":"2024-08-15T17:53:49.902216+0000","last_unstale":"2024-08-15T17:53:49.909139+0000","last_undegraded":"2024-08-15T17:53:49.909139+0000","last_fullsized":"2024-08-15T17:53:49.909139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905961+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.905961+0000","last_peered":"2024-08-15T17:53:50.905961+0000","last_clean":"2024-08-15T17:53:50.905961+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.905961+0000","last_undegraded":"2024-08-15T17:53:50.905961+0000","last_fullsized":"2024-08-15T17:53:50.905961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929634+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929634+0000","last_peered":"2024-08-15T17:53:50.929634+0000","last_clean":"2024-08-15T17:53:50.929634+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929634+0000","last_undegraded":"2024-08-15T17:53:50.929634+0000","last_fullsized":"2024-08-15T17:53:50.929634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.919099+0000","last_change":"2024-08-15T17:53:50.919099+0000","last_active":"2024-08-15T17:53:50.919099+0000","last_peered":"2024-08-15T17:53:50.919099+0000","last_clean":"2024-08-15T17:53:50.919099+0000","last_became_active":"2024-08-15T17:53:50.918636+0000","last_became_peered":"2024-08-15T17:53:50.918636+0000","last_unstale":"2024-08-15T17:53:50.919099+0000","last_undegraded":"2024-08-15T17:53:50.919099+0000","last_fullsized":"2024-08-15T17:53:50.919099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.937468+0000","last_change":"2024-08-15T17:53:49.901002+0000","last_active":"2024-08-15T17:53:50.937468+0000","last_peered":"2024-08-15T17:53:50.937468+0000","last_clean":"2024-08-15T17:53:50.937468+0000","last_became_active":"2024-08-15T17:53:49.900687+0000","last_became_peered":"2024-08-15T17:53:49.900687+0000","last_unstale":"2024-08-15T17:53:50.937468+0000","last_undegraded":"2024-08-15T17:53:50.937468+0000","last_fullsized":"2024-08-15T17:53:50.937468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:00:56.507072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915295+0000","last_change":"2024-08-15T17:53:50.915295+0000","last_active":"2024-08-15T17:53:50.915295+0000","last_peered":"2024-08-15T17:53:50.915295+0000","last_clean":"2024-08-15T17:53:50.915295+0000","last_became_active":"2024-08-15T17:53:50.914142+0000","last_became_peered":"2024-08-15T17:53:50.914142+0000","last_unstale":"2024-08-15T17:53:50.915295+0000","last_undegraded":"2024-08-15T17:53:50.915295+0000","last_fullsized":"2024-08-15T17:53:50.915295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:56.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928289+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928289+0000","last_peered":"2024-08-15T17:53:50.928289+0000","last_clean":"2024-08-15T17:53:50.928289+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928289+0000","last_undegraded":"2024-08-15T17:53:50.928289+0000","last_fullsized":"2024-08-15T17:53:50.928289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921696+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.921696+0000","last_peered":"2024-08-15T17:53:50.921696+0000","last_clean":"2024-08-15T17:53:50.921696+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.921696+0000","last_undegraded":"2024-08-15T17:53:50.921696+0000","last_fullsized":"2024-08-15T17:53:50.921696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907160+0000","last_change":"2024-08-15T17:53:49.902363+0000","last_active":"2024-08-15T17:53:49.907160+0000","last_peered":"2024-08-15T17:53:49.907160+0000","last_clean":"2024-08-15T17:53:49.907160+0000","last_became_active":"2024-08-15T17:53:49.902061+0000","last_became_peered":"2024-08-15T17:53:49.902061+0000","last_unstale":"2024-08-15T17:53:49.907160+0000","last_undegraded":"2024-08-15T17:53:49.907160+0000","last_fullsized":"2024-08-15T17:53:49.907160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916048+0000","last_change":"2024-08-15T17:53:50.916048+0000","last_active":"2024-08-15T17:53:50.916048+0000","last_peered":"2024-08-15T17:53:50.916048+0000","last_clean":"2024-08-15T17:53:50.916048+0000","last_became_active":"2024-08-15T17:53:50.915821+0000","last_became_peered":"2024-08-15T17:53:50.915821+0000","last_unstale":"2024-08-15T17:53:50.916048+0000","last_undegraded":"2024-08-15T17:53:50.916048+0000","last_fullsized":"2024-08-15T17:53:50.916048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:52:59.537353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.911565+0000","last_change":"2024-08-15T17:53:49.906337+0000","last_active":"2024-08-15T17:53:49.911565+0000","last_peered":"2024-08-15T17:53:49.911565+0000","last_clean":"2024-08-15T17:53:49.911565+0000","last_became_active":"2024-08-15T17:53:49.906050+0000","last_became_peered":"2024-08-15T17:53:49.906050+0000","last_unstale":"2024-08-15T17:53:49.911565+0000","last_undegraded":"2024-08-15T17:53:49.911565+0000","last_fullsized":"2024-08-15T17:53:49.911565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912426+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.912426+0000","last_peered":"2024-08-15T17:53:50.912426+0000","last_clean":"2024-08-15T17:53:50.912426+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.912426+0000","last_undegraded":"2024-08-15T17:53:50.912426+0000","last_fullsized":"2024-08-15T17:53:50.912426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935090+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935090+0000","last_peered":"2024-08-15T17:53:50.935090+0000","last_clean":"2024-08-15T17:53:50.935090+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935090+0000","last_undegraded":"2024-08-15T17:53:50.935090+0000","last_fullsized":"2024-08-15T17:53:50.935090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918891+0000","last_change":"2024-08-15T17:53:50.918891+0000","last_active":"2024-08-15T17:53:50.918891+0000","last_peered":"2024-08-15T17:53:50.918891+0000","last_clean":"2024-08-15T17:53:50.918891+0000","last_became_active":"2024-08-15T17:53:50.918558+0000","last_became_peered":"2024-08-15T17:53:50.918558+0000","last_unstale":"2024-08-15T17:53:50.918891+0000","last_undegraded":"2024-08-15T17:53:50.918891+0000","last_fullsized":"2024-08-15T17:53:50.918891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893270+0000","last_change":"2024-08-15T17:53:49.911008+0000","last_active":"2024-08-15T17:53:50.893270+0000","last_peered":"2024-08-15T17:53:50.893270+0000","last_clean":"2024-08-15T17:53:50.893270+0000","last_became_active":"2024-08-15T17:53:49.910689+0000","last_became_peered":"2024-08-15T17:53:49.910689+0000","last_unstale":"2024-08-15T17:53:50.893270+0000","last_undegraded":"2024-08-15T17:53:50.893270+0000","last_fullsized":"2024-08-15T17:53:50.893270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907379+0000","last_change":"2024-08-15T17:53:50.904230+0000","last_active":"2024-08-15T17:53:50.907379+0000","last_peered":"2024-08-15T17:53:50.907379+0000","last_clean":"2024-08-15T17:53:50.907379+0000","last_became_active":"2024-08-15T17:53:50.903601+0000","last_became_peered":"2024-08-15T17:53:50.903601+0000","last_unstale":"2024-08-15T17:53:50.907379+0000","last_undegraded":"2024-08-15T17:53:50.907379+0000","last_fullsized":"2024-08-15T17:53:50.907379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:52.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926959+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.926959+0000","last_peered":"2024-08-15T17:53:50.926959+0000","last_clean":"2024-08-15T17:53:50.926959+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.926959+0000","last_undegraded":"2024-08-15T17:53:50.926959+0000","last_fullsized":"2024-08-15T17:53:50.926959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913859+0000","last_change":"2024-08-15T17:53:50.913859+0000","last_active":"2024-08-15T17:53:50.913859+0000","last_peered":"2024-08-15T17:53:50.913859+0000","last_clean":"2024-08-15T17:53:50.913859+0000","last_became_active":"2024-08-15T17:53:50.912444+0000","last_became_peered":"2024-08-15T17:53:50.912444+0000","last_unstale":"2024-08-15T17:53:50.913859+0000","last_undegraded":"2024-08-15T17:53:50.913859+0000","last_fullsized":"2024-08-15T17:53:50.913859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901201+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.901201+0000","last_peered":"2024-08-15T17:53:50.901201+0000","last_clean":"2024-08-15T17:53:50.901201+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.901201+0000","last_undegraded":"2024-08-15T17:53:50.901201+0000","last_fullsized":"2024-08-15T17:53:50.901201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907476+0000","last_change":"2024-08-15T17:53:50.907476+0000","last_active":"2024-08-15T17:53:50.907476+0000","last_peered":"2024-08-15T17:53:50.907476+0000","last_clean":"2024-08-15T17:53:50.907476+0000","last_became_active":"2024-08-15T17:53:50.907146+0000","last_became_peered":"2024-08-15T17:53:50.907146+0000","last_unstale":"2024-08-15T17:53:50.907476+0000","last_undegraded":"2024-08-15T17:53:50.907476+0000","last_fullsized":"2024-08-15T17:53:50.907476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:32:00.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915462+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:49.915462+0000","last_peered":"2024-08-15T17:53:49.915462+0000","last_clean":"2024-08-15T17:53:49.915462+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:49.915462+0000","last_undegraded":"2024-08-15T17:53:49.915462+0000","last_fullsized":"2024-08-15T17:53:49.915462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911334+0000","last_change":"2024-08-15T17:53:50.911334+0000","last_active":"2024-08-15T17:53:50.911334+0000","last_peered":"2024-08-15T17:53:50.911334+0000","last_clean":"2024-08-15T17:53:50.911334+0000","last_became_active":"2024-08-15T17:53:50.911063+0000","last_became_peered":"2024-08-15T17:53:50.911063+0000","last_unstale":"2024-08-15T17:53:50.911334+0000","last_undegraded":"2024-08-15T17:53:50.911334+0000","last_fullsized":"2024-08-15T17:53:50.911334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:43:02.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.896396+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:49.896396+0000","last_peered":"2024-08-15T17:53:49.896396+0000","last_clean":"2024-08-15T17:53:49.896396+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:49.896396+0000","last_undegraded":"2024-08-15T17:53:49.896396+0000","last_fullsized":"2024-08-15T17:53:49.896396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907296+0000","last_change":"2024-08-15T17:53:49.903821+0000","last_active":"2024-08-15T17:53:49.907296+0000","last_peered":"2024-08-15T17:53:49.907296+0000","last_clean":"2024-08-15T17:53:49.907296+0000","last_became_active":"2024-08-15T17:53:49.903160+0000","last_became_peered":"2024-08-15T17:53:49.903160+0000","last_unstale":"2024-08-15T17:53:49.907296+0000","last_undegraded":"2024-08-15T17:53:49.907296+0000","last_fullsized":"2024-08-15T17:53:49.907296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:15.247369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905075+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.905075+0000","last_peered":"2024-08-15T17:53:50.905075+0000","last_clean":"2024-08-15T17:53:50.905075+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.905075+0000","last_undegraded":"2024-08-15T17:53:50.905075+0000","last_fullsized":"2024-08-15T17:53:50.905075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.912813+0000","last_change":"2024-08-15T17:53:49.911873+0000","last_active":"2024-08-15T17:53:49.912813+0000","last_peered":"2024-08-15T17:53:49.912813+0000","last_clean":"2024-08-15T17:53:49.912813+0000","last_became_active":"2024-08-15T17:53:49.911498+0000","last_became_peered":"2024-08-15T17:53:49.911498+0000","last_unstale":"2024-08-15T17:53:49.912813+0000","last_undegraded":"2024-08-15T17:53:49.912813+0000","last_fullsized":"2024-08-15T17:53:49.912813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906668+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.906668+0000","last_peered":"2024-08-15T17:53:50.906668+0000","last_clean":"2024-08-15T17:53:50.906668+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906668+0000","last_undegraded":"2024-08-15T17:53:50.906668+0000","last_fullsized":"2024-08-15T17:53:50.906668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915216+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:49.915216+0000","last_peered":"2024-08-15T17:53:49.915216+0000","last_clean":"2024-08-15T17:53:49.915216+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:49.915216+0000","last_undegraded":"2024-08-15T17:53:49.915216+0000","last_fullsized":"2024-08-15T17:53:49.915216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913148+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.913148+0000","last_peered":"2024-08-15T17:53:50.913148+0000","last_clean":"2024-08-15T17:53:50.913148+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.913148+0000","last_undegraded":"2024-08-15T17:53:50.913148+0000","last_fullsized":"2024-08-15T17:53:50.913148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907139+0000","last_change":"2024-08-15T17:53:49.902223+0000","last_active":"2024-08-15T17:53:49.907139+0000","last_peered":"2024-08-15T17:53:49.907139+0000","last_clean":"2024-08-15T17:53:49.907139+0000","last_became_active":"2024-08-15T17:53:49.901891+0000","last_became_peered":"2024-08-15T17:53:49.901891+0000","last_unstale":"2024-08-15T17:53:49.907139+0000","last_undegraded":"2024-08-15T17:53:49.907139+0000","last_fullsized":"2024-08-15T17:53:49.907139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:35.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903676+0000","last_change":"2024-08-15T17:53:50.903676+0000","last_active":"2024-08-15T17:53:50.903676+0000","last_peered":"2024-08-15T17:53:50.903676+0000","last_clean":"2024-08-15T17:53:50.903676+0000","last_became_active":"2024-08-15T17:53:50.903374+0000","last_became_peered":"2024-08-15T17:53:50.903374+0000","last_unstale":"2024-08-15T17:53:50.903676+0000","last_undegraded":"2024-08-15T17:53:50.903676+0000","last_fullsized":"2024-08-15T17:53:50.903676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917918+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:49.917918+0000","last_peered":"2024-08-15T17:53:49.917918+0000","last_clean":"2024-08-15T17:53:49.917918+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:49.917918+0000","last_undegraded":"2024-08-15T17:53:49.917918+0000","last_fullsized":"2024-08-15T17:53:49.917918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916594+0000","last_change":"2024-08-15T17:53:50.909590+0000","last_active":"2024-08-15T17:53:50.916594+0000","last_peered":"2024-08-15T17:53:50.916594+0000","last_clean":"2024-08-15T17:53:50.916594+0000","last_became_active":"2024-08-15T17:53:50.908589+0000","last_became_peered":"2024-08-15T17:53:50.908589+0000","last_unstale":"2024-08-15T17:53:50.916594+0000","last_undegraded":"2024-08-15T17:53:50.916594+0000","last_fullsized":"2024-08-15T17:53:50.916594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:37.384281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.907189+0000","last_change":"2024-08-15T17:53:49.902247+0000","last_active":"2024-08-15T17:53:49.907189+0000","last_peered":"2024-08-15T17:53:49.907189+0000","last_clean":"2024-08-15T17:53:49.907189+0000","last_became_active":"2024-08-15T17:53:49.901925+0000","last_became_peered":"2024-08-15T17:53:49.901925+0000","last_unstale":"2024-08-15T17:53:49.907189+0000","last_undegraded":"2024-08-15T17:53:49.907189+0000","last_fullsized":"2024-08-15T17:53:49.907189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907678+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.907678+0000","last_peered":"2024-08-15T17:53:50.907678+0000","last_clean":"2024-08-15T17:53:50.907678+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.907678+0000","last_undegraded":"2024-08-15T17:53:50.907678+0000","last_fullsized":"2024-08-15T17:53:50.907678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.917817+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:49.917817+0000","last_peered":"2024-08-15T17:53:49.917817+0000","last_clean":"2024-08-15T17:53:49.917817+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:49.917817+0000","last_undegraded":"2024-08-15T17:53:49.917817+0000","last_fullsized":"2024-08-15T17:53:49.917817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906946+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.906946+0000","last_peered":"2024-08-15T17:53:50.906946+0000","last_clean":"2024-08-15T17:53:50.906946+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.906946+0000","last_undegraded":"2024-08-15T17:53:50.906946+0000","last_fullsized":"2024-08-15T17:53:50.906946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932432+0000","last_change":"2024-08-15T17:53:49.909938+0000","last_active":"2024-08-15T17:53:50.932432+0000","last_peered":"2024-08-15T17:53:50.932432+0000","last_clean":"2024-08-15T17:53:50.932432+0000","last_became_active":"2024-08-15T17:53:49.909683+0000","last_became_peered":"2024-08-15T17:53:49.909683+0000","last_unstale":"2024-08-15T17:53:50.932432+0000","last_undegraded":"2024-08-15T17:53:50.932432+0000","last_fullsized":"2024-08-15T17:53:50.932432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:40.919685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907271+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.907271+0000","last_peered":"2024-08-15T17:53:50.907271+0000","last_clean":"2024-08-15T17:53:50.907271+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.907271+0000","last_undegraded":"2024-08-15T17:53:50.907271+0000","last_fullsized":"2024-08-15T17:53:50.907271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.911667+0000","last_change":"2024-08-15T17:53:49.906864+0000","last_active":"2024-08-15T17:53:49.911667+0000","last_peered":"2024-08-15T17:53:49.911667+0000","last_clean":"2024-08-15T17:53:49.911667+0000","last_became_active":"2024-08-15T17:53:49.906562+0000","last_became_peered":"2024-08-15T17:53:49.906562+0000","last_unstale":"2024-08-15T17:53:49.911667+0000","last_undegraded":"2024-08-15T17:53:49.911667+0000","last_fullsized":"2024-08-15T17:53:49.911667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914663+0000","last_change":"2024-08-15T17:53:50.914663+0000","last_active":"2024-08-15T17:53:50.914663+0000","last_peered":"2024-08-15T17:53:50.914663+0000","last_clean":"2024-08-15T17:53:50.914663+0000","last_became_active":"2024-08-15T17:53:50.914323+0000","last_became_peered":"2024-08-15T17:53:50.914323+0000","last_unstale":"2024-08-15T17:53:50.914663+0000","last_undegraded":"2024-08-15T17:53:50.914663+0000","last_fullsized":"2024-08-15T17:53:50.914663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915065+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:49.915065+0000","last_peered":"2024-08-15T17:53:49.915065+0000","last_clean":"2024-08-15T17:53:49.915065+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:49.915065+0000","last_undegraded":"2024-08-15T17:53:49.915065+0000","last_fullsized":"2024-08-15T17:53:49.915065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907755+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.907755+0000","last_peered":"2024-08-15T17:53:50.907755+0000","last_clean":"2024-08-15T17:53:50.907755+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.907755+0000","last_undegraded":"2024-08-15T17:53:50.907755+0000","last_fullsized":"2024-08-15T17:53:50.907755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-15T17:53:49.915510+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:49.915510+0000","last_peered":"2024-08-15T17:53:49.915510+0000","last_clean":"2024-08-15T17:53:49.915510+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:49.915510+0000","last_undegraded":"2024-08-15T17:53:49.915510+0000","last_fullsized":"2024-08-15T17:53:49.915510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910580+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.910580+0000","last_peered":"2024-08-15T17:53:50.910580+0000","last_clean":"2024-08-15T17:53:50.910580+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.910580+0000","last_undegraded":"2024-08-15T17:53:50.910580+0000","last_fullsized":"2024-08-15T17:53:50.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.930100+0000","last_change":"2024-08-15T17:53:49.903999+0000","last_active":"2024-08-15T17:53:50.930100+0000","last_peered":"2024-08-15T17:53:50.930100+0000","last_clean":"2024-08-15T17:53:50.930100+0000","last_became_active":"2024-08-15T17:53:49.903565+0000","last_became_peered":"2024-08-15T17:53:49.903565+0000","last_unstale":"2024-08-15T17:53:50.930100+0000","last_undegraded":"2024-08-15T17:53:50.930100+0000","last_fullsized":"2024-08-15T17:53:50.930100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:04:25.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.918330+0000","last_change":"2024-08-15T17:53:50.918330+0000","last_active":"2024-08-15T17:53:50.918330+0000","last_peered":"2024-08-15T17:53:50.918330+0000","last_clean":"2024-08-15T17:53:50.918330+0000","last_became_active":"2024-08-15T17:53:50.917987+0000","last_became_peered":"2024-08-15T17:53:50.917987+0000","last_unstale":"2024-08-15T17:53:50.918330+0000","last_undegraded":"2024-08-15T17:53:50.918330+0000","last_fullsized":"2024-08-15T17:53:50.918330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:58:12.793849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909037+0000","last_change":"2024-08-15T17:53:50.909037+0000","last_active":"2024-08-15T17:53:50.909037+0000","last_peered":"2024-08-15T17:53:50.909037+0000","last_clean":"2024-08-15T17:53:50.909037+0000","last_became_active":"2024-08-15T17:53:50.908705+0000","last_became_peered":"2024-08-15T17:53:50.908705+0000","last_unstale":"2024-08-15T17:53:50.909037+0000","last_undegraded":"2024-08-15T17:53:50.909037+0000","last_fullsized":"2024-08-15T17:53:50.909037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:50:09.164360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928060+0000","last_change":"2024-08-15T17:53:49.902233+0000","last_active":"2024-08-15T17:53:50.928060+0000","last_peered":"2024-08-15T17:53:50.928060+0000","last_clean":"2024-08-15T17:53:50.928060+0000","last_became_active":"2024-08-15T17:53:49.901894+0000","last_became_peered":"2024-08-15T17:53:49.901894+0000","last_unstale":"2024-08-15T17:53:50.928060+0000","last_undegraded":"2024-08-15T17:53:50.928060+0000","last_fullsized":"2024-08-15T17:53:50.928060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913554+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.913554+0000","last_peered":"2024-08-15T17:53:50.913554+0000","last_clean":"2024-08-15T17:53:50.913554+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.913554+0000","last_undegraded":"2024-08-15T17:53:50.913554+0000","last_fullsized":"2024-08-15T17:53:50.913554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927981+0000","last_change":"2024-08-15T17:53:49.902248+0000","last_active":"2024-08-15T17:53:50.927981+0000","last_peered":"2024-08-15T17:53:50.927981+0000","last_clean":"2024-08-15T17:53:50.927981+0000","last_became_active":"2024-08-15T17:53:49.901911+0000","last_became_peered":"2024-08-15T17:53:49.901911+0000","last_unstale":"2024-08-15T17:53:50.927981+0000","last_undegraded":"2024-08-15T17:53:50.927981+0000","last_fullsized":"2024-08-15T17:53:50.927981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910641+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.910641+0000","last_peered":"2024-08-15T17:53:50.910641+0000","last_clean":"2024-08-15T17:53:50.910641+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.910641+0000","last_undegraded":"2024-08-15T17:53:50.910641+0000","last_fullsized":"2024-08-15T17:53:50.910641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901431+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.901431+0000","last_peered":"2024-08-15T17:53:50.901431+0000","last_clean":"2024-08-15T17:53:50.901431+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.901431+0000","last_undegraded":"2024-08-15T17:53:50.901431+0000","last_fullsized":"2024-08-15T17:53:50.901431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.908002+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.908002+0000","last_peered":"2024-08-15T17:53:50.908002+0000","last_clean":"2024-08-15T17:53:50.908002+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.908002+0000","last_undegraded":"2024-08-15T17:53:50.908002+0000","last_fullsized":"2024-08-15T17:53:50.908002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927882+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.927882+0000","last_peered":"2024-08-15T17:53:50.927882+0000","last_clean":"2024-08-15T17:53:50.927882+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.927882+0000","last_undegraded":"2024-08-15T17:53:50.927882+0000","last_fullsized":"2024-08-15T17:53:50.927882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":200704,"data_stored":67157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":68139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":66643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":66711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":184320,"data_stored":59824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":798720,"data_stored":657047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":68799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":794624,"data_stored":657025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:53:58.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:53:58.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54bc41e700 1 Processor -- start 2024-08-15T17:53:58.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54bc41e700 1 -- start start 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54bc41e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f54b406f040 0x7f54b40aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54bc41e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40adf50 con 0x7f54b40ace80 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54bc41e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40ad340 con 0x7f54b4156f80 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54bc41e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40ad620 con 0x7f54b406f040 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b99b9700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f54b40ace80 0x7f54b4157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46768/0 (socket says 172.21.15.33:46768) 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b99b9700 1 -- 172.21.15.33:0/2513367450 learned_addr learned my addr 172.21.15.33:0/2513367450 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54ba9bb700 1 --2- 172.21.15.33:0/2513367450 >> v2:172.21.15.105:3300/0 conn(0x7f54b406f040 0x7f54b40aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354323266 0 0) 0x7f54b40adf50 con 0x7f54b40ace80 2024-08-15T17:53:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a0003570 con 0x7f54b40ace80 2024-08-15T17:53:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231466680 0 0) 0x7f54b40ad340 con 0x7f54b4156f80 2024-08-15T17:53:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b40adf50 con 0x7f54b4156f80 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155423258 0 0) 0x7f54a0003570 con 0x7f54b40ace80 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 >> v2:172.21.15.105:3300/0 conn(0x7f54b406f040 msgr2=0x7f54b40aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 --2- 172.21.15.33:0/2513367450 >> v2:172.21.15.105:3300/0 conn(0x7f54b406f040 0x7f54b40aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.399+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 >> v1:172.21.15.105:6789/0 conn(0x7f54b4156f80 legacy=0x7f54b40ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40ad900 con 0x7f54b40ace80 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f54b0001470 con 0x7f54b40ace80 2024-08-15T17:53:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 >> v1:172.21.15.33:6789/0 conn(0x7f54b40ace80 legacy=0x7f54b4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a0003bf0 0x7f54a0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a0004810 0x7f54a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40ad620 con 0x7f54a00051c0 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a000c160 con 0x7f54a0004810 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a000c320 con 0x7f54a0003bf0 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba1ba700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a0003bf0 0x7f54a0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b99b9700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a0004810 0x7f54a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 -- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a0003bf0 msgr2=0x7f54a0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a0003bf0 0x7f54a0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 -- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a0004810 msgr2=0x7f54a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a0004810 0x7f54a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 -- 172.21.15.33:0/2513367450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0003570 con 0x7f54a00051c0 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 -- 172.21.15.33:0/2513367450 reap_dead start 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54ba9bb700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54a000ba60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0094d0 tx=0x7f54ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6789bf816ad25262 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00ea60 con 0x7f54a00051c0 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00f040 con 0x7f54a00051c0 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54b91b8700 1 -- 172.21.15.33:0/2513367450 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00ee30 con 0x7f54a00051c0 2024-08-15T17:53:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 -- 172.21.15.33:0/2513367450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 msgr2=0x7f54a000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54a000ba60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0094d0 tx=0x7f54ac00b040 comp rx=0 tx=0).stop 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 -- 172.21.15.33:0/2513367450 shutdown_connections 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2513367450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54a000ba60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 -- 172.21.15.33:0/2513367450 >> 172.21.15.33:0/2513367450 conn(0x7f54b4066e00 msgr2=0x7f54b4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 -- 172.21.15.33:0/2513367450 shutdown_connections 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.403+0000 7f54bc41e700 1 -- 172.21.15.33:0/2513367450 wait complete. 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 Processor -- start 2024-08-15T17:53:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 -- start start 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54b41676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b4149820 0x7f54b40c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b4149c90 0x7f54b40c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40c0d40 con 0x7f54a00051c0 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4167bf0 con 0x7f54b4149c90 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4098a80 con 0x7f54b4149820 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54b41676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54b41676b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35206/0 (socket says 172.21.15.33:35206) 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 -- 172.21.15.33:0/2878805818 learned_addr learned my addr 172.21.15.33:0/2878805818 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba9bb700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b4149c90 0x7f54b40c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54b99b9700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b4149820 0x7f54b40c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 -- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b4149820 msgr2=0x7f54b40c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b4149820 0x7f54b40c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 -- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b4149c90 msgr2=0x7f54b40c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b4149c90 0x7f54b40c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 -- 172.21.15.33:0/2878805818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40c0fb0 con 0x7f54a00051c0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54ba1ba700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54b41676b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54a4002b50 tx=0x7f54a4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400f8d0 con 0x7f54a00051c0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400fa50 con 0x7f54a00051c0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40c1290 con 0x7f54a00051c0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400fe10 con 0x7f54a00051c0 2024-08-15T17:53:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.407+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b40c3bd0 con 0x7f54a00051c0 2024-08-15T17:53:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.411+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b40645c0 con 0x7f54a00051c0 2024-08-15T17:53:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.411+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f54a4013600 con 0x7f54a00051c0 2024-08-15T17:53:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.411+0000 7f54aa7fc700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5498060860 0x7f5498062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.411+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54a407cb60 con 0x7f54a00051c0 2024-08-15T17:53:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.411+0000 7f54b99b9700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5498060860 0x7f5498062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.411+0000 7f54b99b9700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5498060860 0x7f5498062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54b0001120 tx=0x7f54b0001df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.419+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f54a404cfb0 con 0x7f54a00051c0 2024-08-15T17:53:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.579+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54b406b3c0 con 0x7f5498060860 2024-08-15T17:53:58.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.595+0000 7f54aa7fc700 1 -- 172.21.15.33:0/2878805818 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264521 (secure 0 0 0) 0x7f54b406b3c0 con 0x7f5498060860 2024-08-15T17:53:58.600 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:58.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5498060860 msgr2=0x7f5498062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5498060860 0x7f5498062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54b0001120 tx=0x7f54b0001df0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 msgr2=0x7f54b41676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54b41676b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54a4002b50 tx=0x7f54a4007d30 comp rx=0 tx=0).stop 2024-08-15T17:53:58.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 shutdown_connections 2024-08-15T17:53:58.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5498060860 0x7f5498062d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b4149c90 0x7f54b40c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b4149820 0x7f54b40c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 --2- 172.21.15.33:0/2878805818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a00051c0 0x7f54b41676b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 >> 172.21.15.33:0/2878805818 conn(0x7f54b4066e00 msgr2=0x7f54b40a95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:58.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 shutdown_connections 2024-08-15T17:53:58.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.599+0000 7f54bc41e700 1 -- 172.21.15.33:0/2878805818 wait complete. 2024-08-15T17:53:58.606 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:53:58.618 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-15T17:53:58.239733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385896,"kb_used_data":2856,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588824,"statfs":{"total":773094113280,"available":770650955776,"internally_reserved":0,"allocated":2924544,"data_stored":1768412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002610"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915754+0000","last_change":"2024-08-15T17:53:50.914055+0000","last_active":"2024-08-15T17:53:50.915754+0000","last_peered":"2024-08-15T17:53:50.915754+0000","last_clean":"2024-08-15T17:53:50.915754+0000","last_became_active":"2024-08-15T17:53:50.912515+0000","last_became_peered":"2024-08-15T17:53:50.912515+0000","last_unstale":"2024-08-15T17:53:50.915754+0000","last_undegraded":"2024-08-15T17:53:50.915754+0000","last_fullsized":"2024-08-15T17:53:50.915754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916931+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.916931+0000","last_peered":"2024-08-15T17:53:50.916931+0000","last_clean":"2024-08-15T17:53:50.916931+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.916931+0000","last_undegraded":"2024-08-15T17:53:50.916931+0000","last_fullsized":"2024-08-15T17:53:50.916931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.919237+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.919237+0000","last_peered":"2024-08-15T17:53:50.919237+0000","last_clean":"2024-08-15T17:53:50.919237+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.919237+0000","last_undegraded":"2024-08-15T17:53:50.919237+0000","last_fullsized":"2024-08-15T17:53:50.919237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921467+0000","last_change":"2024-08-15T17:53:50.914898+0000","last_active":"2024-08-15T17:53:50.921467+0000","last_peered":"2024-08-15T17:53:50.921467+0000","last_clean":"2024-08-15T17:53:50.921467+0000","last_became_active":"2024-08-15T17:53:50.914603+0000","last_became_peered":"2024-08-15T17:53:50.914603+0000","last_unstale":"2024-08-15T17:53:50.921467+0000","last_undegraded":"2024-08-15T17:53:50.921467+0000","last_fullsized":"2024-08-15T17:53:50.921467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:11.104066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913847+0000","last_change":"2024-08-15T17:53:50.904384+0000","last_active":"2024-08-15T17:53:50.913847+0000","last_peered":"2024-08-15T17:53:50.913847+0000","last_clean":"2024-08-15T17:53:50.913847+0000","last_became_active":"2024-08-15T17:53:50.904058+0000","last_became_peered":"2024-08-15T17:53:50.904058+0000","last_unstale":"2024-08-15T17:53:50.913847+0000","last_undegraded":"2024-08-15T17:53:50.913847+0000","last_fullsized":"2024-08-15T17:53:50.913847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921547+0000","last_change":"2024-08-15T17:53:50.914850+0000","last_active":"2024-08-15T17:53:50.921547+0000","last_peered":"2024-08-15T17:53:50.921547+0000","last_clean":"2024-08-15T17:53:50.921547+0000","last_became_active":"2024-08-15T17:53:50.914627+0000","last_became_peered":"2024-08-15T17:53:50.914627+0000","last_unstale":"2024-08-15T17:53:50.921547+0000","last_undegraded":"2024-08-15T17:53:50.921547+0000","last_fullsized":"2024-08-15T17:53:50.921547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913990+0000","last_change":"2024-08-15T17:53:50.906406+0000","last_active":"2024-08-15T17:53:50.913990+0000","last_peered":"2024-08-15T17:53:50.913990+0000","last_clean":"2024-08-15T17:53:50.913990+0000","last_became_active":"2024-08-15T17:53:50.906100+0000","last_became_peered":"2024-08-15T17:53:50.906100+0000","last_unstale":"2024-08-15T17:53:50.913990+0000","last_undegraded":"2024-08-15T17:53:50.913990+0000","last_fullsized":"2024-08-15T17:53:50.913990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:13.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909252+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.909252+0000","last_peered":"2024-08-15T17:53:50.909252+0000","last_clean":"2024-08-15T17:53:50.909252+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.909252+0000","last_undegraded":"2024-08-15T17:53:50.909252+0000","last_fullsized":"2024-08-15T17:53:50.909252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.924946+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.924946+0000","last_peered":"2024-08-15T17:53:50.924946+0000","last_clean":"2024-08-15T17:53:50.924946+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.924946+0000","last_undegraded":"2024-08-15T17:53:50.924946+0000","last_fullsized":"2024-08-15T17:53:50.924946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913903+0000","last_change":"2024-08-15T17:53:50.903622+0000","last_active":"2024-08-15T17:53:50.913903+0000","last_peered":"2024-08-15T17:53:50.913903+0000","last_clean":"2024-08-15T17:53:50.913903+0000","last_became_active":"2024-08-15T17:53:50.903273+0000","last_became_peered":"2024-08-15T17:53:50.903273+0000","last_unstale":"2024-08-15T17:53:50.913903+0000","last_undegraded":"2024-08-15T17:53:50.913903+0000","last_fullsized":"2024-08-15T17:53:50.913903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915664+0000","last_change":"2024-08-15T17:53:50.913949+0000","last_active":"2024-08-15T17:53:50.915664+0000","last_peered":"2024-08-15T17:53:50.915664+0000","last_clean":"2024-08-15T17:53:50.915664+0000","last_became_active":"2024-08-15T17:53:50.912318+0000","last_became_peered":"2024-08-15T17:53:50.912318+0000","last_unstale":"2024-08-15T17:53:50.915664+0000","last_undegraded":"2024-08-15T17:53:50.915664+0000","last_fullsized":"2024-08-15T17:53:50.915664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916410+0000","last_change":"2024-08-15T17:53:50.914253+0000","last_active":"2024-08-15T17:53:50.916410+0000","last_peered":"2024-08-15T17:53:50.916410+0000","last_clean":"2024-08-15T17:53:50.916410+0000","last_became_active":"2024-08-15T17:53:50.912891+0000","last_became_peered":"2024-08-15T17:53:50.912891+0000","last_unstale":"2024-08-15T17:53:50.916410+0000","last_undegraded":"2024-08-15T17:53:50.916410+0000","last_fullsized":"2024-08-15T17:53:50.916410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:46.552157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911666+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.911666+0000","last_peered":"2024-08-15T17:53:50.911666+0000","last_clean":"2024-08-15T17:53:50.911666+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.911666+0000","last_undegraded":"2024-08-15T17:53:50.911666+0000","last_fullsized":"2024-08-15T17:53:50.911666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914568+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.914568+0000","last_peered":"2024-08-15T17:53:50.914568+0000","last_clean":"2024-08-15T17:53:50.914568+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.914568+0000","last_undegraded":"2024-08-15T17:53:50.914568+0000","last_fullsized":"2024-08-15T17:53:50.914568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910692+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.910692+0000","last_peered":"2024-08-15T17:53:50.910692+0000","last_clean":"2024-08-15T17:53:50.910692+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.910692+0000","last_undegraded":"2024-08-15T17:53:50.910692+0000","last_fullsized":"2024-08-15T17:53:50.910692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926051+0000","last_change":"2024-08-15T17:53:50.918930+0000","last_active":"2024-08-15T17:53:50.926051+0000","last_peered":"2024-08-15T17:53:50.926051+0000","last_clean":"2024-08-15T17:53:50.926051+0000","last_became_active":"2024-08-15T17:53:50.918540+0000","last_became_peered":"2024-08-15T17:53:50.918540+0000","last_unstale":"2024-08-15T17:53:50.926051+0000","last_undegraded":"2024-08-15T17:53:50.926051+0000","last_fullsized":"2024-08-15T17:53:50.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:47:00.308854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925996+0000","last_change":"2024-08-15T17:53:50.918137+0000","last_active":"2024-08-15T17:53:50.925996+0000","last_peered":"2024-08-15T17:53:50.925996+0000","last_clean":"2024-08-15T17:53:50.925996+0000","last_became_active":"2024-08-15T17:53:50.917839+0000","last_became_peered":"2024-08-15T17:53:50.917839+0000","last_unstale":"2024-08-15T17:53:50.925996+0000","last_undegraded":"2024-08-15T17:53:50.925996+0000","last_fullsized":"2024-08-15T17:53:50.925996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:47:03.604696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912296+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.912296+0000","last_peered":"2024-08-15T17:53:50.912296+0000","last_clean":"2024-08-15T17:53:50.912296+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.912296+0000","last_undegraded":"2024-08-15T17:53:50.912296+0000","last_fullsized":"2024-08-15T17:53:50.912296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922087+0000","last_change":"2024-08-15T17:53:50.915095+0000","last_active":"2024-08-15T17:53:50.922087+0000","last_peered":"2024-08-15T17:53:50.922087+0000","last_clean":"2024-08-15T17:53:50.922087+0000","last_became_active":"2024-08-15T17:53:50.914811+0000","last_became_peered":"2024-08-15T17:53:50.914811+0000","last_unstale":"2024-08-15T17:53:50.922087+0000","last_undegraded":"2024-08-15T17:53:50.922087+0000","last_fullsized":"2024-08-15T17:53:50.922087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915199+0000","last_change":"2024-08-15T17:53:50.911317+0000","last_active":"2024-08-15T17:53:50.915199+0000","last_peered":"2024-08-15T17:53:50.915199+0000","last_clean":"2024-08-15T17:53:50.915199+0000","last_became_active":"2024-08-15T17:53:50.910983+0000","last_became_peered":"2024-08-15T17:53:50.910983+0000","last_unstale":"2024-08-15T17:53:50.915199+0000","last_undegraded":"2024-08-15T17:53:50.915199+0000","last_fullsized":"2024-08-15T17:53:50.915199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:17:53.857852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914138+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.914138+0000","last_peered":"2024-08-15T17:53:50.914138+0000","last_clean":"2024-08-15T17:53:50.914138+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.914138+0000","last_undegraded":"2024-08-15T17:53:50.914138+0000","last_fullsized":"2024-08-15T17:53:50.914138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922366+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.922366+0000","last_peered":"2024-08-15T17:53:50.922366+0000","last_clean":"2024-08-15T17:53:50.922366+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.922366+0000","last_undegraded":"2024-08-15T17:53:50.922366+0000","last_fullsized":"2024-08-15T17:53:50.922366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909117+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.909117+0000","last_peered":"2024-08-15T17:53:50.909117+0000","last_clean":"2024-08-15T17:53:50.909117+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.909117+0000","last_undegraded":"2024-08-15T17:53:50.909117+0000","last_fullsized":"2024-08-15T17:53:50.909117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920128+0000","last_change":"2024-08-15T17:53:50.908561+0000","last_active":"2024-08-15T17:53:50.920128+0000","last_peered":"2024-08-15T17:53:50.920128+0000","last_clean":"2024-08-15T17:53:50.920128+0000","last_became_active":"2024-08-15T17:53:50.908263+0000","last_became_peered":"2024-08-15T17:53:50.908263+0000","last_unstale":"2024-08-15T17:53:50.920128+0000","last_undegraded":"2024-08-15T17:53:50.920128+0000","last_fullsized":"2024-08-15T17:53:50.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:07:38.806189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916877+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.916877+0000","last_peered":"2024-08-15T17:53:50.916877+0000","last_clean":"2024-08-15T17:53:50.916877+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.916877+0000","last_undegraded":"2024-08-15T17:53:50.916877+0000","last_fullsized":"2024-08-15T17:53:50.916877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925176+0000","last_change":"2024-08-15T17:53:50.921735+0000","last_active":"2024-08-15T17:53:50.925176+0000","last_peered":"2024-08-15T17:53:50.925176+0000","last_clean":"2024-08-15T17:53:50.925176+0000","last_became_active":"2024-08-15T17:53:50.921323+0000","last_became_peered":"2024-08-15T17:53:50.921323+0000","last_unstale":"2024-08-15T17:53:50.925176+0000","last_undegraded":"2024-08-15T17:53:50.925176+0000","last_fullsized":"2024-08-15T17:53:50.925176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:36.650250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914480+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.914480+0000","last_peered":"2024-08-15T17:53:50.914480+0000","last_clean":"2024-08-15T17:53:50.914480+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.914480+0000","last_undegraded":"2024-08-15T17:53:50.914480+0000","last_fullsized":"2024-08-15T17:53:50.914480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911449+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.911449+0000","last_peered":"2024-08-15T17:53:50.911449+0000","last_clean":"2024-08-15T17:53:50.911449+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.911449+0000","last_undegraded":"2024-08-15T17:53:50.911449+0000","last_fullsized":"2024-08-15T17:53:50.911449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916933+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.916933+0000","last_peered":"2024-08-15T17:53:50.916933+0000","last_clean":"2024-08-15T17:53:50.916933+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.916933+0000","last_undegraded":"2024-08-15T17:53:50.916933+0000","last_fullsized":"2024-08-15T17:53:50.916933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922176+0000","last_change":"2024-08-15T17:53:50.916828+0000","last_active":"2024-08-15T17:53:50.922176+0000","last_peered":"2024-08-15T17:53:50.922176+0000","last_clean":"2024-08-15T17:53:50.922176+0000","last_became_active":"2024-08-15T17:53:50.916514+0000","last_became_peered":"2024-08-15T17:53:50.916514+0000","last_unstale":"2024-08-15T17:53:50.922176+0000","last_undegraded":"2024-08-15T17:53:50.922176+0000","last_fullsized":"2024-08-15T17:53:50.922176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:35:47.822736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914327+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.914327+0000","last_peered":"2024-08-15T17:53:50.914327+0000","last_clean":"2024-08-15T17:53:50.914327+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.914327+0000","last_undegraded":"2024-08-15T17:53:50.914327+0000","last_fullsized":"2024-08-15T17:53:50.914327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916688+0000","last_change":"2024-08-15T17:53:50.912831+0000","last_active":"2024-08-15T17:53:50.916688+0000","last_peered":"2024-08-15T17:53:50.916688+0000","last_clean":"2024-08-15T17:53:50.916688+0000","last_became_active":"2024-08-15T17:53:50.912616+0000","last_became_peered":"2024-08-15T17:53:50.912616+0000","last_unstale":"2024-08-15T17:53:50.916688+0000","last_undegraded":"2024-08-15T17:53:50.916688+0000","last_fullsized":"2024-08-15T17:53:50.916688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915811+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.915811+0000","last_peered":"2024-08-15T17:53:50.915811+0000","last_clean":"2024-08-15T17:53:50.915811+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.915811+0000","last_undegraded":"2024-08-15T17:53:50.915811+0000","last_fullsized":"2024-08-15T17:53:50.915811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925040+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.925040+0000","last_peered":"2024-08-15T17:53:50.925040+0000","last_clean":"2024-08-15T17:53:50.925040+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.925040+0000","last_undegraded":"2024-08-15T17:53:50.925040+0000","last_fullsized":"2024-08-15T17:53:50.925040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914159+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.914159+0000","last_peered":"2024-08-15T17:53:50.914159+0000","last_clean":"2024-08-15T17:53:50.914159+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.914159+0000","last_undegraded":"2024-08-15T17:53:50.914159+0000","last_fullsized":"2024-08-15T17:53:50.914159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932271+0000","last_change":"2024-08-15T17:53:49.909777+0000","last_active":"2024-08-15T17:53:50.932271+0000","last_peered":"2024-08-15T17:53:50.932271+0000","last_clean":"2024-08-15T17:53:50.932271+0000","last_became_active":"2024-08-15T17:53:49.909444+0000","last_became_peered":"2024-08-15T17:53:49.909444+0000","last_unstale":"2024-08-15T17:53:50.932271+0000","last_undegraded":"2024-08-15T17:53:50.932271+0000","last_fullsized":"2024-08-15T17:53:50.932271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.902509+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:50.902509+0000","last_peered":"2024-08-15T17:53:50.902509+0000","last_clean":"2024-08-15T17:53:50.902509+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:50.902509+0000","last_undegraded":"2024-08-15T17:53:50.902509+0000","last_fullsized":"2024-08-15T17:53:50.902509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.917061+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.917061+0000","last_peered":"2024-08-15T17:53:50.917061+0000","last_clean":"2024-08-15T17:53:50.917061+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.917061+0000","last_undegraded":"2024-08-15T17:53:50.917061+0000","last_fullsized":"2024-08-15T17:53:50.917061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.900928+0000","last_change":"2024-08-15T17:53:49.905568+0000","last_active":"2024-08-15T17:53:50.900928+0000","last_peered":"2024-08-15T17:53:50.900928+0000","last_clean":"2024-08-15T17:53:50.900928+0000","last_became_active":"2024-08-15T17:53:49.905264+0000","last_became_peered":"2024-08-15T17:53:49.905264+0000","last_unstale":"2024-08-15T17:53:50.900928+0000","last_undegraded":"2024-08-15T17:53:50.900928+0000","last_fullsized":"2024-08-15T17:53:50.900928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:45.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916759+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.916759+0000","last_peered":"2024-08-15T17:53:50.916759+0000","last_clean":"2024-08-15T17:53:50.916759+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.916759+0000","last_undegraded":"2024-08-15T17:53:50.916759+0000","last_fullsized":"2024-08-15T17:53:50.916759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907737+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:50.907737+0000","last_peered":"2024-08-15T17:53:50.907737+0000","last_clean":"2024-08-15T17:53:50.907737+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:50.907737+0000","last_undegraded":"2024-08-15T17:53:50.907737+0000","last_fullsized":"2024-08-15T17:53:50.907737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925197+0000","last_change":"2024-08-15T17:53:50.922614+0000","last_active":"2024-08-15T17:53:50.925197+0000","last_peered":"2024-08-15T17:53:50.925197+0000","last_clean":"2024-08-15T17:53:50.925197+0000","last_became_active":"2024-08-15T17:53:50.922233+0000","last_became_peered":"2024-08-15T17:53:50.922233+0000","last_unstale":"2024-08-15T17:53:50.925197+0000","last_undegraded":"2024-08-15T17:53:50.925197+0000","last_fullsized":"2024-08-15T17:53:50.925197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:41.928727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.891019+0000","last_change":"2024-08-15T17:53:49.902494+0000","last_active":"2024-08-15T17:53:50.891019+0000","last_peered":"2024-08-15T17:53:50.891019+0000","last_clean":"2024-08-15T17:53:50.891019+0000","last_became_active":"2024-08-15T17:53:49.902216+0000","last_became_peered":"2024-08-15T17:53:49.902216+0000","last_unstale":"2024-08-15T17:53:50.891019+0000","last_undegraded":"2024-08-15T17:53:50.891019+0000","last_fullsized":"2024-08-15T17:53:50.891019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909269+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.909269+0000","last_peered":"2024-08-15T17:53:50.909269+0000","last_clean":"2024-08-15T17:53:50.909269+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.909269+0000","last_undegraded":"2024-08-15T17:53:50.909269+0000","last_fullsized":"2024-08-15T17:53:50.909269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929796+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929796+0000","last_peered":"2024-08-15T17:53:50.929796+0000","last_clean":"2024-08-15T17:53:50.929796+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929796+0000","last_undegraded":"2024-08-15T17:53:50.929796+0000","last_fullsized":"2024-08-15T17:53:50.929796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926118+0000","last_change":"2024-08-15T17:53:50.919099+0000","last_active":"2024-08-15T17:53:50.926118+0000","last_peered":"2024-08-15T17:53:50.926118+0000","last_clean":"2024-08-15T17:53:50.926118+0000","last_became_active":"2024-08-15T17:53:50.918636+0000","last_became_peered":"2024-08-15T17:53:50.918636+0000","last_unstale":"2024-08-15T17:53:50.926118+0000","last_undegraded":"2024-08-15T17:53:50.926118+0000","last_fullsized":"2024-08-15T17:53:50.926118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.937468+0000","last_change":"2024-08-15T17:53:49.901002+0000","last_active":"2024-08-15T17:53:50.937468+0000","last_peered":"2024-08-15T17:53:50.937468+0000","last_clean":"2024-08-15T17:53:50.937468+0000","last_became_active":"2024-08-15T17:53:49.900687+0000","last_became_peered":"2024-08-15T17:53:49.900687+0000","last_unstale":"2024-08-15T17:53:50.937468+0000","last_undegraded":"2024-08-15T17:53:50.937468+0000","last_fullsized":"2024-08-15T17:53:50.937468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:00:56.507072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916662+0000","last_change":"2024-08-15T17:53:50.915295+0000","last_active":"2024-08-15T17:53:50.916662+0000","last_peered":"2024-08-15T17:53:50.916662+0000","last_clean":"2024-08-15T17:53:50.916662+0000","last_became_active":"2024-08-15T17:53:50.914142+0000","last_became_peered":"2024-08-15T17:53:50.914142+0000","last_unstale":"2024-08-15T17:53:50.916662+0000","last_undegraded":"2024-08-15T17:53:50.916662+0000","last_fullsized":"2024-08-15T17:53:50.916662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:56.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928512+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928512+0000","last_peered":"2024-08-15T17:53:50.928512+0000","last_clean":"2024-08-15T17:53:50.928512+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928512+0000","last_undegraded":"2024-08-15T17:53:50.928512+0000","last_fullsized":"2024-08-15T17:53:50.928512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922626+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.922626+0000","last_peered":"2024-08-15T17:53:50.922626+0000","last_clean":"2024-08-15T17:53:50.922626+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.922626+0000","last_undegraded":"2024-08-15T17:53:50.922626+0000","last_fullsized":"2024-08-15T17:53:50.922626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903791+0000","last_change":"2024-08-15T17:53:49.902363+0000","last_active":"2024-08-15T17:53:50.903791+0000","last_peered":"2024-08-15T17:53:50.903791+0000","last_clean":"2024-08-15T17:53:50.903791+0000","last_became_active":"2024-08-15T17:53:49.902061+0000","last_became_peered":"2024-08-15T17:53:49.902061+0000","last_unstale":"2024-08-15T17:53:50.903791+0000","last_undegraded":"2024-08-15T17:53:50.903791+0000","last_fullsized":"2024-08-15T17:53:50.903791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920873+0000","last_change":"2024-08-15T17:53:50.916048+0000","last_active":"2024-08-15T17:53:50.920873+0000","last_peered":"2024-08-15T17:53:50.920873+0000","last_clean":"2024-08-15T17:53:50.920873+0000","last_became_active":"2024-08-15T17:53:50.915821+0000","last_became_peered":"2024-08-15T17:53:50.915821+0000","last_unstale":"2024-08-15T17:53:50.920873+0000","last_undegraded":"2024-08-15T17:53:50.920873+0000","last_fullsized":"2024-08-15T17:53:50.920873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:52:59.537353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.889576+0000","last_change":"2024-08-15T17:53:49.906337+0000","last_active":"2024-08-15T17:53:50.889576+0000","last_peered":"2024-08-15T17:53:50.889576+0000","last_clean":"2024-08-15T17:53:50.889576+0000","last_became_active":"2024-08-15T17:53:49.906050+0000","last_became_peered":"2024-08-15T17:53:49.906050+0000","last_unstale":"2024-08-15T17:53:50.889576+0000","last_undegraded":"2024-08-15T17:53:50.889576+0000","last_fullsized":"2024-08-15T17:53:50.889576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913496+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.913496+0000","last_peered":"2024-08-15T17:53:50.913496+0000","last_clean":"2024-08-15T17:53:50.913496+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.913496+0000","last_undegraded":"2024-08-15T17:53:50.913496+0000","last_fullsized":"2024-08-15T17:53:50.913496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935231+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935231+0000","last_peered":"2024-08-15T17:53:50.935231+0000","last_clean":"2024-08-15T17:53:50.935231+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935231+0000","last_undegraded":"2024-08-15T17:53:50.935231+0000","last_fullsized":"2024-08-15T17:53:50.935231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926113+0000","last_change":"2024-08-15T17:53:50.918891+0000","last_active":"2024-08-15T17:53:50.926113+0000","last_peered":"2024-08-15T17:53:50.926113+0000","last_clean":"2024-08-15T17:53:50.926113+0000","last_became_active":"2024-08-15T17:53:50.918558+0000","last_became_peered":"2024-08-15T17:53:50.918558+0000","last_unstale":"2024-08-15T17:53:50.926113+0000","last_undegraded":"2024-08-15T17:53:50.926113+0000","last_fullsized":"2024-08-15T17:53:50.926113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927838+0000","last_change":"2024-08-15T17:53:49.911008+0000","last_active":"2024-08-15T17:53:50.927838+0000","last_peered":"2024-08-15T17:53:50.927838+0000","last_clean":"2024-08-15T17:53:50.927838+0000","last_became_active":"2024-08-15T17:53:49.910689+0000","last_became_peered":"2024-08-15T17:53:49.910689+0000","last_unstale":"2024-08-15T17:53:50.927838+0000","last_undegraded":"2024-08-15T17:53:50.927838+0000","last_fullsized":"2024-08-15T17:53:50.927838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907379+0000","last_change":"2024-08-15T17:53:50.904230+0000","last_active":"2024-08-15T17:53:50.907379+0000","last_peered":"2024-08-15T17:53:50.907379+0000","last_clean":"2024-08-15T17:53:50.907379+0000","last_became_active":"2024-08-15T17:53:50.903601+0000","last_became_peered":"2024-08-15T17:53:50.903601+0000","last_unstale":"2024-08-15T17:53:50.907379+0000","last_undegraded":"2024-08-15T17:53:50.907379+0000","last_fullsized":"2024-08-15T17:53:50.907379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:52.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927051+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.927051+0000","last_peered":"2024-08-15T17:53:50.927051+0000","last_clean":"2024-08-15T17:53:50.927051+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.927051+0000","last_undegraded":"2024-08-15T17:53:50.927051+0000","last_fullsized":"2024-08-15T17:53:50.927051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915634+0000","last_change":"2024-08-15T17:53:50.913859+0000","last_active":"2024-08-15T17:53:50.915634+0000","last_peered":"2024-08-15T17:53:50.915634+0000","last_clean":"2024-08-15T17:53:50.915634+0000","last_became_active":"2024-08-15T17:53:50.912444+0000","last_became_peered":"2024-08-15T17:53:50.912444+0000","last_unstale":"2024-08-15T17:53:50.915634+0000","last_undegraded":"2024-08-15T17:53:50.915634+0000","last_fullsized":"2024-08-15T17:53:50.915634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928230+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.928230+0000","last_peered":"2024-08-15T17:53:50.928230+0000","last_clean":"2024-08-15T17:53:50.928230+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.928230+0000","last_undegraded":"2024-08-15T17:53:50.928230+0000","last_fullsized":"2024-08-15T17:53:50.928230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915176+0000","last_change":"2024-08-15T17:53:50.907476+0000","last_active":"2024-08-15T17:53:50.915176+0000","last_peered":"2024-08-15T17:53:50.915176+0000","last_clean":"2024-08-15T17:53:50.915176+0000","last_became_active":"2024-08-15T17:53:50.907146+0000","last_became_peered":"2024-08-15T17:53:50.907146+0000","last_unstale":"2024-08-15T17:53:50.915176+0000","last_undegraded":"2024-08-15T17:53:50.915176+0000","last_fullsized":"2024-08-15T17:53:50.915176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:32:00.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906127+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:50.906127+0000","last_peered":"2024-08-15T17:53:50.906127+0000","last_clean":"2024-08-15T17:53:50.906127+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:50.906127+0000","last_undegraded":"2024-08-15T17:53:50.906127+0000","last_fullsized":"2024-08-15T17:53:50.906127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920590+0000","last_change":"2024-08-15T17:53:50.911334+0000","last_active":"2024-08-15T17:53:50.920590+0000","last_peered":"2024-08-15T17:53:50.920590+0000","last_clean":"2024-08-15T17:53:50.920590+0000","last_became_active":"2024-08-15T17:53:50.911063+0000","last_became_peered":"2024-08-15T17:53:50.911063+0000","last_unstale":"2024-08-15T17:53:50.920590+0000","last_undegraded":"2024-08-15T17:53:50.920590+0000","last_fullsized":"2024-08-15T17:53:50.920590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:43:02.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907635+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:50.907635+0000","last_peered":"2024-08-15T17:53:50.907635+0000","last_clean":"2024-08-15T17:53:50.907635+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:50.907635+0000","last_undegraded":"2024-08-15T17:53:50.907635+0000","last_fullsized":"2024-08-15T17:53:50.907635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901688+0000","last_change":"2024-08-15T17:53:49.903821+0000","last_active":"2024-08-15T17:53:50.901688+0000","last_peered":"2024-08-15T17:53:50.901688+0000","last_clean":"2024-08-15T17:53:50.901688+0000","last_became_active":"2024-08-15T17:53:49.903160+0000","last_became_peered":"2024-08-15T17:53:49.903160+0000","last_unstale":"2024-08-15T17:53:50.901688+0000","last_undegraded":"2024-08-15T17:53:50.901688+0000","last_fullsized":"2024-08-15T17:53:50.901688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:15.247369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914180+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.914180+0000","last_peered":"2024-08-15T17:53:50.914180+0000","last_clean":"2024-08-15T17:53:50.914180+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.914180+0000","last_undegraded":"2024-08-15T17:53:50.914180+0000","last_fullsized":"2024-08-15T17:53:50.914180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901032+0000","last_change":"2024-08-15T17:53:49.911873+0000","last_active":"2024-08-15T17:53:50.901032+0000","last_peered":"2024-08-15T17:53:50.901032+0000","last_clean":"2024-08-15T17:53:50.901032+0000","last_became_active":"2024-08-15T17:53:49.911498+0000","last_became_peered":"2024-08-15T17:53:49.911498+0000","last_unstale":"2024-08-15T17:53:50.901032+0000","last_undegraded":"2024-08-15T17:53:50.901032+0000","last_fullsized":"2024-08-15T17:53:50.901032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910897+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.910897+0000","last_peered":"2024-08-15T17:53:50.910897+0000","last_clean":"2024-08-15T17:53:50.910897+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.910897+0000","last_undegraded":"2024-08-15T17:53:50.910897+0000","last_fullsized":"2024-08-15T17:53:50.910897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893174+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:50.893174+0000","last_peered":"2024-08-15T17:53:50.893174+0000","last_clean":"2024-08-15T17:53:50.893174+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:50.893174+0000","last_undegraded":"2024-08-15T17:53:50.893174+0000","last_fullsized":"2024-08-15T17:53:50.893174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.917041+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.917041+0000","last_peered":"2024-08-15T17:53:50.917041+0000","last_clean":"2024-08-15T17:53:50.917041+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.917041+0000","last_undegraded":"2024-08-15T17:53:50.917041+0000","last_fullsized":"2024-08-15T17:53:50.917041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903922+0000","last_change":"2024-08-15T17:53:49.902223+0000","last_active":"2024-08-15T17:53:50.903922+0000","last_peered":"2024-08-15T17:53:50.903922+0000","last_clean":"2024-08-15T17:53:50.903922+0000","last_became_active":"2024-08-15T17:53:49.901891+0000","last_became_peered":"2024-08-15T17:53:49.901891+0000","last_unstale":"2024-08-15T17:53:50.903922+0000","last_undegraded":"2024-08-15T17:53:50.903922+0000","last_fullsized":"2024-08-15T17:53:50.903922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:35.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913818+0000","last_change":"2024-08-15T17:53:50.903676+0000","last_active":"2024-08-15T17:53:50.913818+0000","last_peered":"2024-08-15T17:53:50.913818+0000","last_clean":"2024-08-15T17:53:50.913818+0000","last_became_active":"2024-08-15T17:53:50.903374+0000","last_became_peered":"2024-08-15T17:53:50.903374+0000","last_unstale":"2024-08-15T17:53:50.913818+0000","last_undegraded":"2024-08-15T17:53:50.913818+0000","last_fullsized":"2024-08-15T17:53:50.913818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901086+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:50.901086+0000","last_peered":"2024-08-15T17:53:50.901086+0000","last_clean":"2024-08-15T17:53:50.901086+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:50.901086+0000","last_undegraded":"2024-08-15T17:53:50.901086+0000","last_fullsized":"2024-08-15T17:53:50.901086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916594+0000","last_change":"2024-08-15T17:53:50.909590+0000","last_active":"2024-08-15T17:53:50.916594+0000","last_peered":"2024-08-15T17:53:50.916594+0000","last_clean":"2024-08-15T17:53:50.916594+0000","last_became_active":"2024-08-15T17:53:50.908589+0000","last_became_peered":"2024-08-15T17:53:50.908589+0000","last_unstale":"2024-08-15T17:53:50.916594+0000","last_undegraded":"2024-08-15T17:53:50.916594+0000","last_fullsized":"2024-08-15T17:53:50.916594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:37.384281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901052+0000","last_change":"2024-08-15T17:53:49.902247+0000","last_active":"2024-08-15T17:53:50.901052+0000","last_peered":"2024-08-15T17:53:50.901052+0000","last_clean":"2024-08-15T17:53:50.901052+0000","last_became_active":"2024-08-15T17:53:49.901925+0000","last_became_peered":"2024-08-15T17:53:49.901925+0000","last_unstale":"2024-08-15T17:53:50.901052+0000","last_undegraded":"2024-08-15T17:53:50.901052+0000","last_fullsized":"2024-08-15T17:53:50.901052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911493+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.911493+0000","last_peered":"2024-08-15T17:53:50.911493+0000","last_clean":"2024-08-15T17:53:50.911493+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.911493+0000","last_undegraded":"2024-08-15T17:53:50.911493+0000","last_fullsized":"2024-08-15T17:53:50.911493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-15T17:53:52.711988+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:52.711988+0000","last_peered":"2024-08-15T17:53:52.711988+0000","last_clean":"2024-08-15T17:53:52.711988+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:52.711988+0000","last_undegraded":"2024-08-15T17:53:52.711988+0000","last_fullsized":"2024-08-15T17:53:52.711988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916680+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.916680+0000","last_peered":"2024-08-15T17:53:50.916680+0000","last_clean":"2024-08-15T17:53:50.916680+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.916680+0000","last_undegraded":"2024-08-15T17:53:50.916680+0000","last_fullsized":"2024-08-15T17:53:50.916680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932574+0000","last_change":"2024-08-15T17:53:49.909938+0000","last_active":"2024-08-15T17:53:50.932574+0000","last_peered":"2024-08-15T17:53:50.932574+0000","last_clean":"2024-08-15T17:53:50.932574+0000","last_became_active":"2024-08-15T17:53:49.909683+0000","last_became_peered":"2024-08-15T17:53:49.909683+0000","last_unstale":"2024-08-15T17:53:50.932574+0000","last_undegraded":"2024-08-15T17:53:50.932574+0000","last_fullsized":"2024-08-15T17:53:50.932574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:40.919685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916565+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.916565+0000","last_peered":"2024-08-15T17:53:50.916565+0000","last_clean":"2024-08-15T17:53:50.916565+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.916565+0000","last_undegraded":"2024-08-15T17:53:50.916565+0000","last_fullsized":"2024-08-15T17:53:50.916565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.889238+0000","last_change":"2024-08-15T17:53:49.906864+0000","last_active":"2024-08-15T17:53:50.889238+0000","last_peered":"2024-08-15T17:53:50.889238+0000","last_clean":"2024-08-15T17:53:50.889238+0000","last_became_active":"2024-08-15T17:53:49.906562+0000","last_became_peered":"2024-08-15T17:53:49.906562+0000","last_unstale":"2024-08-15T17:53:50.889238+0000","last_undegraded":"2024-08-15T17:53:50.889238+0000","last_fullsized":"2024-08-15T17:53:50.889238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920687+0000","last_change":"2024-08-15T17:53:50.914663+0000","last_active":"2024-08-15T17:53:50.920687+0000","last_peered":"2024-08-15T17:53:50.920687+0000","last_clean":"2024-08-15T17:53:50.920687+0000","last_became_active":"2024-08-15T17:53:50.914323+0000","last_became_peered":"2024-08-15T17:53:50.914323+0000","last_unstale":"2024-08-15T17:53:50.920687+0000","last_undegraded":"2024-08-15T17:53:50.920687+0000","last_fullsized":"2024-08-15T17:53:50.920687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893998+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:50.893998+0000","last_peered":"2024-08-15T17:53:50.893998+0000","last_clean":"2024-08-15T17:53:50.893998+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:50.893998+0000","last_undegraded":"2024-08-15T17:53:50.893998+0000","last_fullsized":"2024-08-15T17:53:50.893998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916724+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.916724+0000","last_peered":"2024-08-15T17:53:50.916724+0000","last_clean":"2024-08-15T17:53:50.916724+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.916724+0000","last_undegraded":"2024-08-15T17:53:50.916724+0000","last_fullsized":"2024-08-15T17:53:50.916724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905841+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:50.905841+0000","last_peered":"2024-08-15T17:53:50.905841+0000","last_clean":"2024-08-15T17:53:50.905841+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:50.905841+0000","last_undegraded":"2024-08-15T17:53:50.905841+0000","last_fullsized":"2024-08-15T17:53:50.905841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914395+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.914395+0000","last_peered":"2024-08-15T17:53:50.914395+0000","last_clean":"2024-08-15T17:53:50.914395+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.914395+0000","last_undegraded":"2024-08-15T17:53:50.914395+0000","last_fullsized":"2024-08-15T17:53:50.914395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.930230+0000","last_change":"2024-08-15T17:53:49.903999+0000","last_active":"2024-08-15T17:53:50.930230+0000","last_peered":"2024-08-15T17:53:50.930230+0000","last_clean":"2024-08-15T17:53:50.930230+0000","last_became_active":"2024-08-15T17:53:49.903565+0000","last_became_peered":"2024-08-15T17:53:49.903565+0000","last_unstale":"2024-08-15T17:53:50.930230+0000","last_undegraded":"2024-08-15T17:53:50.930230+0000","last_fullsized":"2024-08-15T17:53:50.930230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:04:25.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926035+0000","last_change":"2024-08-15T17:53:50.918330+0000","last_active":"2024-08-15T17:53:50.926035+0000","last_peered":"2024-08-15T17:53:50.926035+0000","last_clean":"2024-08-15T17:53:50.926035+0000","last_became_active":"2024-08-15T17:53:50.917987+0000","last_became_peered":"2024-08-15T17:53:50.917987+0000","last_unstale":"2024-08-15T17:53:50.926035+0000","last_undegraded":"2024-08-15T17:53:50.926035+0000","last_fullsized":"2024-08-15T17:53:50.926035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:58:12.793849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920381+0000","last_change":"2024-08-15T17:53:50.909037+0000","last_active":"2024-08-15T17:53:50.920381+0000","last_peered":"2024-08-15T17:53:50.920381+0000","last_clean":"2024-08-15T17:53:50.920381+0000","last_became_active":"2024-08-15T17:53:50.908705+0000","last_became_peered":"2024-08-15T17:53:50.908705+0000","last_unstale":"2024-08-15T17:53:50.920381+0000","last_undegraded":"2024-08-15T17:53:50.920381+0000","last_fullsized":"2024-08-15T17:53:50.920381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:50:09.164360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928245+0000","last_change":"2024-08-15T17:53:49.902233+0000","last_active":"2024-08-15T17:53:50.928245+0000","last_peered":"2024-08-15T17:53:50.928245+0000","last_clean":"2024-08-15T17:53:50.928245+0000","last_became_active":"2024-08-15T17:53:49.901894+0000","last_became_peered":"2024-08-15T17:53:49.901894+0000","last_unstale":"2024-08-15T17:53:50.928245+0000","last_undegraded":"2024-08-15T17:53:50.928245+0000","last_fullsized":"2024-08-15T17:53:50.928245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916585+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.916585+0000","last_peered":"2024-08-15T17:53:50.916585+0000","last_clean":"2024-08-15T17:53:50.916585+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.916585+0000","last_undegraded":"2024-08-15T17:53:50.916585+0000","last_fullsized":"2024-08-15T17:53:50.916585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928119+0000","last_change":"2024-08-15T17:53:49.902248+0000","last_active":"2024-08-15T17:53:50.928119+0000","last_peered":"2024-08-15T17:53:50.928119+0000","last_clean":"2024-08-15T17:53:50.928119+0000","last_became_active":"2024-08-15T17:53:49.901911+0000","last_became_peered":"2024-08-15T17:53:49.901911+0000","last_unstale":"2024-08-15T17:53:50.928119+0000","last_undegraded":"2024-08-15T17:53:50.928119+0000","last_fullsized":"2024-08-15T17:53:50.928119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916752+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.916752+0000","last_peered":"2024-08-15T17:53:50.916752+0000","last_clean":"2024-08-15T17:53:50.916752+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.916752+0000","last_undegraded":"2024-08-15T17:53:50.916752+0000","last_fullsized":"2024-08-15T17:53:50.916752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926596+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.926596+0000","last_peered":"2024-08-15T17:53:50.926596+0000","last_clean":"2024-08-15T17:53:50.926596+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.926596+0000","last_undegraded":"2024-08-15T17:53:50.926596+0000","last_fullsized":"2024-08-15T17:53:50.926596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910788+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.910788+0000","last_peered":"2024-08-15T17:53:50.910788+0000","last_clean":"2024-08-15T17:53:50.910788+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.910788+0000","last_undegraded":"2024-08-15T17:53:50.910788+0000","last_fullsized":"2024-08-15T17:53:50.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929149+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.929149+0000","last_peered":"2024-08-15T17:53:50.929149+0000","last_clean":"2024-08-15T17:53:50.929149+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.929149+0000","last_undegraded":"2024-08-15T17:53:50.929149+0000","last_fullsized":"2024-08-15T17:53:50.929149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":212992,"data_stored":73445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":72931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":72875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":663335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":806912,"data_stored":663313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:53:58.623 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-15T17:53:58.624 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-15T17:53:58.624 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-15T17:53:58.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-15T17:53:58.624 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-15T17:53:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 Processor -- start 2024-08-15T17:53:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 -- start start 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e8015aa30 0x7f7e8015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7e800b3b30 0x7f7e800b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8015a820 con 0x7f7e800aac50 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8015bc90 con 0x7f7e800b3b30 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e873e1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800b4490 con 0x7f7e8015aa30 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8517d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7e800aac50 0x7f7e801574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46770/0 (socket says 172.21.15.33:46770) 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8517d700 1 -- 172.21.15.33:0/307488991 learned_addr learned my addr 172.21.15.33:0/307488991 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8497c700 1 --2- 172.21.15.33:0/307488991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e8015aa30 0x7f7e8015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8597e700 1 --2- 172.21.15.33:0/307488991 >> v2:172.21.15.105:3300/0 conn(0x7f7e800b3b30 0x7f7e800b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e7ffff700 1 -- 172.21.15.33:0/307488991 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449969085 0 0) 0x7f7e78001610 con 0x7f7e800aac50 2024-08-15T17:53:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e7ffff700 1 -- 172.21.15.33:0/307488991 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e6c003570 con 0x7f7e800aac50 2024-08-15T17:53:58.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8497c700 1 -- 172.21.15.33:0/307488991 >> v2:172.21.15.105:3300/0 conn(0x7f7e800b3b30 msgr2=0x7f7e800b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:58.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8497c700 1 --2- 172.21.15.33:0/307488991 >> v2:172.21.15.105:3300/0 conn(0x7f7e800b3b30 0x7f7e800b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8497c700 1 -- 172.21.15.33:0/307488991 >> v1:172.21.15.33:6789/0 conn(0x7f7e800aac50 legacy=0x7f7e801574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8497c700 1 -- 172.21.15.33:0/307488991 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8015b010 con 0x7f7e8015aa30 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e8497c700 1 --2- 172.21.15.33:0/307488991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e8015aa30 0x7f7e8015a2e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e680098e0 tx=0x7f7e680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e878b7c0fcda8a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e7ffff700 1 -- 172.21.15.33:0/307488991 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011630 con 0x7f7e8015aa30 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e7ffff700 1 -- 172.21.15.33:0/307488991 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68011790 con 0x7f7e8015aa30 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.735+0000 7f7e7ffff700 1 -- 172.21.15.33:0/307488991 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011b10 con 0x7f7e8015aa30 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- 172.21.15.33:0/307488991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e8015aa30 msgr2=0x7f7e8015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 --2- 172.21.15.33:0/307488991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e8015aa30 0x7f7e8015a2e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e680098e0 tx=0x7f7e680091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- 172.21.15.33:0/307488991 shutdown_connections 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 --2- 172.21.15.33:0/307488991 >> v2:172.21.15.105:3300/0 conn(0x7f7e800b3b30 0x7f7e800b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 --2- 172.21.15.33:0/307488991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e8015aa30 0x7f7e8015a2e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- 172.21.15.33:0/307488991 >> 172.21.15.33:0/307488991 conn(0x7f7e800994d0 msgr2=0x7f7e800675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- 172.21.15.33:0/307488991 shutdown_connections 2024-08-15T17:53:58.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- 172.21.15.33:0/307488991 wait complete. 2024-08-15T17:53:58.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 Processor -- start 2024-08-15T17:53:58.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- start start 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e800aac50 0x7f7e801536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 0x7f7e800aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e8015aa30 0x7f7e800ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8015d590 con 0x7f7e800b3b30 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800ad500 con 0x7f7e8015aa30 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e873e1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800ad7e0 con 0x7f7e800aac50 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e8497c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 0x7f7e800aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e8497c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 0x7f7e800aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35214/0 (socket says 172.21.15.33:35214) 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e8497c700 1 -- 172.21.15.33:0/1250584400 learned_addr learned my addr 172.21.15.33:0/1250584400 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e8597e700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e8015aa30 0x7f7e800ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.739+0000 7f7e8517d700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e800aac50 0x7f7e801536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8497c700 1 -- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e800aac50 msgr2=0x7f7e801536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8497c700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e800aac50 0x7f7e801536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8497c700 1 -- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e8015aa30 msgr2=0x7f7e800ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8497c700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e8015aa30 0x7f7e800ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8497c700 1 -- 172.21.15.33:0/1250584400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009420 con 0x7f7e800b3b30 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8517d700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e800aac50 0x7f7e801536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e8497c700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 0x7f7e800aca40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e8015bbd0 tx=0x7f7e68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011b10 con 0x7f7e800b3b30 2024-08-15T17:53:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8015d220 con 0x7f7e800b3b30 2024-08-15T17:53:58.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68000c90 con 0x7f7e800b3b30 2024-08-15T17:53:58.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6801a660 con 0x7f7e800b3b30 2024-08-15T17:53:58.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80153c00 con 0x7f7e800b3b30 2024-08-15T17:53:58.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8015d080 con 0x7f7e800b3b30 2024-08-15T17:53:58.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.743+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7e6801aa50 con 0x7f7e800b3b30 2024-08-15T17:53:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.747+0000 7f7e7d7fa700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7e60060890 0x7f7e60062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.747+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e6807e8d0 con 0x7f7e800b3b30 2024-08-15T17:53:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.747+0000 7f7e8517d700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7e60060890 0x7f7e60062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.747+0000 7f7e8517d700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7e60060890 0x7f7e60062d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e78000f80 tx=0x7f7e78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.751+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7e8015d080 con 0x7f7e800b3b30 2024-08-15T17:53:58.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.967+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7e8015d080 con 0x7f7e800b3b30 2024-08-15T17:53:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.971+0000 7f7e7d7fa700 1 -- 172.21.15.33:0/1250584400 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154542 (secure 0 0 0) 0x7f7e8015d080 con 0x7f7e800b3b30 2024-08-15T17:53:58.977 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:58.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7e60060890 msgr2=0x7f7e60062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7e60060890 0x7f7e60062d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e78000f80 tx=0x7f7e78009040 comp rx=0 tx=0).stop 2024-08-15T17:53:58.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 msgr2=0x7f7e800aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 0x7f7e800aca40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e8015bbd0 tx=0x7f7e68017000 comp rx=0 tx=0).stop 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 shutdown_connections 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7e60060890 0x7f7e60062d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e8015aa30 0x7f7e800ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e800b3b30 0x7f7e800aca40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 --2- 172.21.15.33:0/1250584400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e800aac50 0x7f7e801536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 >> 172.21.15.33:0/1250584400 conn(0x7f7e800994d0 msgr2=0x7f7e800b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 shutdown_connections 2024-08-15T17:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:58.975+0000 7f7e873e1700 1 -- 172.21.15.33:0/1250584400 wait complete. 2024-08-15T17:53:58.992 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":24094},{"type":"v1","addr":"172.21.15.105:6833","nonce":24094}]},"active_addr":"172.21.15.105:6833/24094","active_change":"2024-08-15T17:53:30.217688+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":1263828676}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":3624921042}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":3894737310}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":2308260574}]}]} 2024-08-15T17:53:58.995 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-15T17:53:58.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-15T17:53:58.996 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.099+0000 7f9014886700 1 Processor -- start 2024-08-15T17:53:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.099+0000 7f9014886700 1 -- start start 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f901006e9d0 0x7f901006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f90100b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100aba70 con 0x7f9010155010 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100abd50 con 0x7f901006e9d0 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90100ac030 con 0x7f90100ab540 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9010155010 0x7f9010155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46778/0 (socket says 172.21.15.33:46778) 2024-08-15T17:53:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900ffff700 1 -- 172.21.15.33:0/1603993151 learned_addr learned my addr 172.21.15.33:0/1603993151 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900effd700 1 --2- 172.21.15.33:0/1603993151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f90100b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900f7fe700 1 --2- 172.21.15.33:0/1603993151 >> v2:172.21.15.105:3300/0 conn(0x7f901006e9d0 0x7f901006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900e7fc700 1 -- 172.21.15.33:0/1603993151 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817187042 0 0) 0x7f90100aba70 con 0x7f9010155010 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900e7fc700 1 -- 172.21.15.33:0/1603993151 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ffc003570 con 0x7f9010155010 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900effd700 1 -- 172.21.15.33:0/1603993151 >> v2:172.21.15.105:3300/0 conn(0x7f901006e9d0 msgr2=0x7f901006eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900effd700 1 --2- 172.21.15.33:0/1603993151 >> v2:172.21.15.105:3300/0 conn(0x7f901006e9d0 0x7f901006eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900effd700 1 -- 172.21.15.33:0/1603993151 >> v1:172.21.15.33:6789/0 conn(0x7f9010155010 legacy=0x7f9010155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900effd700 1 -- 172.21.15.33:0/1603993151 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100ac310 con 0x7f90100ab540 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900effd700 1 --2- 172.21.15.33:0/1603993151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f90100b1320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098e0 tx=0x7f8ff80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64fb950c6e002af1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900e7fc700 1 -- 172.21.15.33:0/1603993151 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8011630 con 0x7f90100ab540 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900e7fc700 1 -- 172.21.15.33:0/1603993151 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8011790 con 0x7f90100ab540 2024-08-15T17:53:59.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f900e7fc700 1 -- 172.21.15.33:0/1603993151 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8011b10 con 0x7f90100ab540 2024-08-15T17:53:59.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- 172.21.15.33:0/1603993151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 msgr2=0x7f90100b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 --2- 172.21.15.33:0/1603993151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f90100b1320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098e0 tx=0x7f8ff80091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- 172.21.15.33:0/1603993151 shutdown_connections 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 --2- 172.21.15.33:0/1603993151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f90100b1320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 --2- 172.21.15.33:0/1603993151 >> v2:172.21.15.105:3300/0 conn(0x7f901006e9d0 0x7f901006eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- 172.21.15.33:0/1603993151 >> 172.21.15.33:0/1603993151 conn(0x7f90100678d0 msgr2=0x7f9010067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- 172.21.15.33:0/1603993151 shutdown_connections 2024-08-15T17:53:59.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.103+0000 7f9014886700 1 -- 172.21.15.33:0/1603993151 wait complete. 2024-08-15T17:53:59.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.107+0000 7f9014886700 1 Processor -- start 2024-08-15T17:53:59.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.107+0000 7f9014886700 1 -- start start 2024-08-15T17:53:59.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 0x7f901014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f901014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9010155010 0x7f901014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90101484d0 con 0x7f9010155010 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901014b150 con 0x7f901006e9d0 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901014a2e0 con 0x7f90100ab540 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 0x7f901014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9010155010 0x7f901014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900effd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f901014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 0x7f901014f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55618/0 (socket says 172.21.15.33:55618) 2024-08-15T17:53:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 -- 172.21.15.33:0/2370668116 learned_addr learned my addr 172.21.15.33:0/2370668116 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 -- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 msgr2=0x7f901014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f901014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 -- 172.21.15.33:0/2370668116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9010155010 msgr2=0x7f901014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9010155010 0x7f901014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 -- 172.21.15.33:0/2370668116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009420 con 0x7f901006e9d0 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900ffff700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9010155010 0x7f901014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f900f7fe700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 0x7f901014f5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9000009ef0 tx=0x7f900000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000cb70 con 0x7f901006e9d0 2024-08-15T17:53:59.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900000f040 con 0x7f901006e9d0 2024-08-15T17:53:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901014a530 con 0x7f901006e9d0 2024-08-15T17:53:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000014480 con 0x7f901006e9d0 2024-08-15T17:53:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901014ad70 con 0x7f901006e9d0 2024-08-15T17:53:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.111+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901014b290 con 0x7f901006e9d0 2024-08-15T17:53:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.115+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f90000147f0 con 0x7f901006e9d0 2024-08-15T17:53:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.115+0000 7f90077fe700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ff0060860 0x7f8ff0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.115+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f900007d850 con 0x7f901006e9d0 2024-08-15T17:53:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.115+0000 7f900effd700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ff0060860 0x7f8ff0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.115+0000 7f900effd700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ff0060860 0x7f8ff0062d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f901014b5c0 tx=0x7f8ff8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.123+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f900004dd20 con 0x7f901006e9d0 2024-08-15T17:53:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.291+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90100a5480 con 0x7f901006e9d0 2024-08-15T17:53:59.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f90077fe700 1 -- 172.21.15.33:0/2370668116 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9000051340 con 0x7f901006e9d0 2024-08-15T17:53:59.296 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:59.296 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ff0060860 msgr2=0x7f8ff0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ff0060860 0x7f8ff0062d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f901014b5c0 tx=0x7f8ff8017000 comp rx=0 tx=0).stop 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 msgr2=0x7f901014f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 0x7f901014f5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9000009ef0 tx=0x7f900000b040 comp rx=0 tx=0).stop 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 shutdown_connections 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ff0060860 0x7f8ff0062d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9010155010 0x7f901014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100ab540 0x7f901014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 --2- 172.21.15.33:0/2370668116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901006e9d0 0x7f901014f5b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 >> 172.21.15.33:0/2370668116 conn(0x7f90100678d0 msgr2=0x7f9010153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 shutdown_connections 2024-08-15T17:53:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.295+0000 7f9014886700 1 -- 172.21.15.33:0/2370668116 wait complete. 2024-08-15T17:53:59.310 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-15T17:53:59.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:53:59.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f72cee700 1 Processor -- start 2024-08-15T17:53:59.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f72cee700 1 -- start start 2024-08-15T17:53:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f72cee700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f6c15d5b0 0x7f1f6c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f72cee700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c0cf190 con 0x7f1f6c159040 2024-08-15T17:53:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f72cee700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c0d09a0 con 0x7f1f6c0d0010 2024-08-15T17:53:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f72cee700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c15d9f0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f724ed700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f6c15d5b0 0x7f1f6c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f724ed700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f6c15d5b0 0x7f1f6c0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35220/0 (socket says 172.21.15.33:35220) 2024-08-15T17:53:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f724ed700 1 -- 172.21.15.33:0/2981002883 learned_addr learned my addr 172.21.15.33:0/2981002883 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f724ed700 1 -- 172.21.15.33:0/2981002883 >> v1:172.21.15.105:6789/0 conn(0x7f1f6c0d0010 legacy=0x7f1f6c15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f724ed700 1 -- 172.21.15.33:0/2981002883 >> v1:172.21.15.33:6789/0 conn(0x7f1f6c159040 legacy=0x7f1f6c0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.419+0000 7f1f724ed700 1 -- 172.21.15.33:0/2981002883 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0ce5e0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f724ed700 1 --2- 172.21.15.33:0/2981002883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0d0460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f640099b0 tx=0x7f1f64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137c08281a072933 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f70cea700 1 -- 172.21.15.33:0/2981002883 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400b860 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f70cea700 1 -- 172.21.15.33:0/2981002883 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400b9c0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f70cea700 1 -- 172.21.15.33:0/2981002883 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400bd80 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 -- 172.21.15.33:0/2981002883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 msgr2=0x7f1f6c0d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 --2- 172.21.15.33:0/2981002883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0d0460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f640099b0 tx=0x7f1f64009250 comp rx=0 tx=0).stop 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 -- 172.21.15.33:0/2981002883 shutdown_connections 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 --2- 172.21.15.33:0/2981002883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0d0460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 -- 172.21.15.33:0/2981002883 >> 172.21.15.33:0/2981002883 conn(0x7f1f6c068250 msgr2=0x7f1f6c068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 -- 172.21.15.33:0/2981002883 shutdown_connections 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 -- 172.21.15.33:0/2981002883 wait complete. 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 Processor -- start 2024-08-15T17:53:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.423+0000 7f1f72cee700 1 -- start start 2024-08-15T17:53:59.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f6c0d0010 0x7f1f6c169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6c159040 0x7f1f6c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c16d190 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c16a060 con 0x7f1f6c0d0010 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c16a340 con 0x7f1f6c159040 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f71cec700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f6c0d0010 0x7f1f6c169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35224/0 (socket says 172.21.15.33:35224) 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 -- 172.21.15.33:0/681793251 learned_addr learned my addr 172.21.15.33:0/681793251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f714eb700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6c159040 0x7f1f6c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 -- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6c159040 msgr2=0x7f1f6c0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6c159040 0x7f1f6c0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 -- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f6c0d0010 msgr2=0x7f1f6c169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f6c0d0010 0x7f1f6c169a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 -- 172.21.15.33:0/681793251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640094f0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f724ed700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0ae080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6401f070 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64006ad0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c16a620 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400b860 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c0b19e0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1f6401ab10 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.427+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c0643a0 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.431+0000 7f1f69ffb700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f58060890 0x7f1f58062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.431+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f6407e340 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.431+0000 7f1f71cec700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f58060890 0x7f1f58062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.431+0000 7f1f71cec700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f58060890 0x7f1f58062d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0039e0 tx=0x7f1f5c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.435+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1f6404e810 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.603+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f6c0ce010 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.603+0000 7f1f69ffb700 1 -- 172.21.15.33:0/681793251 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f1f64051e30 con 0x7f1f6c15d5b0 2024-08-15T17:53:59.605 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:53:59.606 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f58060890 msgr2=0x7f1f58062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f58060890 0x7f1f58062d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0039e0 tx=0x7f1f5c007ec0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 msgr2=0x7f1f6c0ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0ae080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64017000 comp rx=0 tx=0).stop 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 shutdown_connections 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f58060890 0x7f1f58062d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f6c15d5b0 0x7f1f6c0ae080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6c159040 0x7f1f6c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 --2- 172.21.15.33:0/681793251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f6c0d0010 0x7f1f6c169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 >> 172.21.15.33:0/681793251 conn(0x7f1f6c068250 msgr2=0x7f1f6c157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 shutdown_connections 2024-08-15T17:53:59.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.607+0000 7f1f72cee700 1 -- 172.21.15.33:0/681793251 wait complete. 2024-08-15T17:53:59.620 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-15T17:53:59.620 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-15T17:53:59.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-15T17:53:59.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-15T17:53:59.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-15T17:53:59.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-15T17:53:59.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-15T17:53:59.623 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-15T17:53:59.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d2c58700 1 Processor -- start 2024-08-15T17:53:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d2c58700 1 -- start start 2024-08-15T17:53:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d2c58700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f45cc14fc20 0x7f45cc156200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d2c58700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc069a40 con 0x7f45cc0ae5d0 2024-08-15T17:53:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d2c58700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc069d20 con 0x7f45cc14f850 2024-08-15T17:53:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d2c58700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc06a000 con 0x7f45cc14fc20 2024-08-15T17:53:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d11f5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f45cc0ae5d0 0x7f45cc0aa440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46788/0 (socket says 172.21.15.33:46788) 2024-08-15T17:53:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d11f5700 1 -- 172.21.15.33:0/3241018413 learned_addr learned my addr 172.21.15.33:0/3241018413 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cbfff700 1 --2- 172.21.15.33:0/3241018413 >> v2:172.21.15.105:3300/0 conn(0x7f45cc14fc20 0x7f45cc156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642832800 0 0) 0x7f45cc069a40 con 0x7f45cc0ae5d0 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4004680 con 0x7f45cc0ae5d0 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737915478 0 0) 0x7f45cc069d20 con 0x7f45cc14f850 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45cc069a40 con 0x7f45cc14f850 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1630924294 0 0) 0x7f45b4004680 con 0x7f45cc0ae5d0 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 >> v2:172.21.15.105:3300/0 conn(0x7f45cc14fc20 msgr2=0x7f45cc156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 --2- 172.21.15.33:0/3241018413 >> v2:172.21.15.105:3300/0 conn(0x7f45cc14fc20 0x7f45cc156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 >> v1:172.21.15.105:6789/0 conn(0x7f45cc14f850 legacy=0x7f45cc0691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc155ce0 con 0x7f45cc0ae5d0 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f45c4004ea0 con 0x7f45cc0ae5d0 2024-08-15T17:53:59.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 >> v1:172.21.15.33:6789/0 conn(0x7f45cc0ae5d0 legacy=0x7f45cc0aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45b4004d00 0x7f45b40050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45b4005920 0x7f45b4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b40062d0 0x7f45b400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc06a000 con 0x7f45b4005920 2024-08-15T17:53:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400d1c0 con 0x7f45b4004d00 2024-08-15T17:53:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400d380 con 0x7f45b40062d0 2024-08-15T17:53:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45cbfff700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45b4005920 0x7f45b4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d09f4700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45b4004d00 0x7f45b40050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.763+0000 7f45d11f5700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b40062d0 0x7f45b400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 Processor -- start 2024-08-15T17:53:59.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cbfff700 1 -- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b40062d0 msgr2=0x7f45b400cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cbfff700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b40062d0 0x7f45b400cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cbfff700 1 -- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45b4004d00 msgr2=0x7f45b40050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cbfff700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45b4004d00 0x7f45b40050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cbfff700 1 -- 172.21.15.33:0/3241018413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4004680 con 0x7f45b4005920 2024-08-15T17:53:59.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 -- start start 2024-08-15T17:53:59.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d11f5700 1 -- 172.21.15.33:0/3241018413 reap_dead start 2024-08-15T17:53:59.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cbfff700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45b4005920 0x7f45b4005d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45cc06a770 tx=0x7f45bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956beb546aa0a8bd server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc013720 con 0x7f45b4005920 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc013880 con 0x7f45b4005920 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45cb7fe700 1 -- 172.21.15.33:0/3241018413 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc013c40 con 0x7f45b4005920 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0098155310 0x7f00980b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f009806e7a0 0x7f009806eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009806f0e0 con 0x7f00980ab5e0 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980abb80 con 0x7f009806e7a0 2024-08-15T17:53:59.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009cbc6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980abe60 con 0x7f0098155310 2024-08-15T17:53:59.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 -- 172.21.15.33:0/3241018413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45b4005920 msgr2=0x7f45b4005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45b4005920 0x7f45b4005d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45cc06a770 tx=0x7f45bc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f0096d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f009806e7a0 0x7f009806eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009659c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0098155310 0x7f00980b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f0096d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f009806e7a0 0x7f009806eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35236/0 (socket says 172.21.15.33:35236) 2024-08-15T17:53:59.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f0096d9d700 1 -- 172.21.15.33:0/1562489011 learned_addr learned my addr 172.21.15.33:0/1562489011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 -- 172.21.15.33:0/3241018413 shutdown_connections 2024-08-15T17:53:59.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 --2- 172.21.15.33:0/3241018413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45b4005920 0x7f45b4005d90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 -- 172.21.15.33:0/3241018413 >> 172.21.15.33:0/3241018413 conn(0x7f45cc068300 msgr2=0x7f45cc0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 -- 172.21.15.33:0/3241018413 shutdown_connections 2024-08-15T17:53:59.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f45d2c58700 1 -- 172.21.15.33:0/3241018413 wait complete. 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 Processor -- start 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 -- start start 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffa5406e470 0x7ffa5406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 0x7ffa540cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa541610c0 con 0x7ffa540adf10 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa54158290 con 0x7ffa5406e470 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa59aba700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5415dff0 con 0x7ffa540cad40 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa537fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ffa540adf10 0x7ffa540ae2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46790/0 (socket says 172.21.15.33:46790) 2024-08-15T17:53:59.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7ffa537fe700 1 -- 172.21.15.33:0/1281294592 learned_addr learned my addr 172.21.15.33:0/1281294592 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009659c700 1 -- 172.21.15.33:0/1562489011 >> v2:172.21.15.33:3300/0 conn(0x7f009806e7a0 msgr2=0x7f009806eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009659c700 1 --2- 172.21.15.33:0/1562489011 >> v2:172.21.15.33:3300/0 conn(0x7f009806e7a0 0x7f009806eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009659c700 1 -- 172.21.15.33:0/1562489011 >> v1:172.21.15.105:6789/0 conn(0x7f00980ab5e0 legacy=0x7f00981556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009659c700 1 -- 172.21.15.33:0/1562489011 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980ac140 con 0x7f0098155310 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009659c700 1 --2- 172.21.15.33:0/1562489011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 0x7f00980b14e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f00980685a0 tx=0x7f00880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6bd962a76b40e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009559a700 1 -- 172.21.15.33:0/1562489011 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088012980 con 0x7f0098155310 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009559a700 1 -- 172.21.15.33:0/1562489011 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800c070 con 0x7f0098155310 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.767+0000 7f009559a700 1 -- 172.21.15.33:0/1562489011 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088012d10 con 0x7f0098155310 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- 172.21.15.33:0/1562489011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 msgr2=0x7f00980b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 --2- 172.21.15.33:0/1562489011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 0x7f00980b14e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f00980685a0 tx=0x7f00880091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- 172.21.15.33:0/1562489011 shutdown_connections 2024-08-15T17:53:59.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 --2- 172.21.15.33:0/1562489011 >> v2:172.21.15.33:3300/0 conn(0x7f009806e7a0 0x7f009806eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 --2- 172.21.15.33:0/1562489011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 0x7f00980b14e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- 172.21.15.33:0/1562489011 >> 172.21.15.33:0/1562489011 conn(0x7f0098067890 msgr2=0x7f0098067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa53fff700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 0x7ffa540cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa52ffd700 1 --2- 172.21.15.33:0/1281294592 >> v2:172.21.15.105:3300/0 conn(0x7ffa5406e470 0x7ffa5406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017483575 0 0) 0x7ffa541610c0 con 0x7ffa540adf10 2024-08-15T17:53:59.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c003570 con 0x7ffa540adf10 2024-08-15T17:53:59.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- 172.21.15.33:0/1562489011 shutdown_connections 2024-08-15T17:53:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1080456364 0 0) 0x7ffa3c003570 con 0x7ffa540adf10 2024-08-15T17:53:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 msgr2=0x7ffa540cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 0x7ffa540cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 >> v2:172.21.15.105:3300/0 conn(0x7ffa5406e470 msgr2=0x7ffa5406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 --2- 172.21.15.33:0/1281294592 >> v2:172.21.15.105:3300/0 conn(0x7ffa5406e470 0x7ffa5406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5415e2d0 con 0x7ffa540adf10 2024-08-15T17:53:59.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7ffa4c001810 con 0x7ffa540adf10 2024-08-15T17:53:59.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 >> v1:172.21.15.33:6789/0 conn(0x7ffa540adf10 legacy=0x7ffa540ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- 172.21.15.33:0/1562489011 wait complete. 2024-08-15T17:53:59.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 Processor -- start 2024-08-15T17:53:59.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 -- start start 2024-08-15T17:53:59.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b4005920 0x7f45cc14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc0b0030 0x7f45cc158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45cc0b04a0 0x7f45cc159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc097d50 con 0x7f45cc0b0030 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0b0a10 con 0x7f45cc0b04a0 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d2c58700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0b0cf0 con 0x7f45b4005920 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc0b0030 0x7f45cc158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc0b0030 0x7f45cc158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35252/0 (socket says 172.21.15.33:35252) 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 -- 172.21.15.33:0/2517879433 learned_addr learned my addr 172.21.15.33:0/2517879433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d09f4700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b4005920 0x7f45cc14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45d11f5700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45cc0b04a0 0x7f45cc159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 Processor -- start 2024-08-15T17:53:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa3c003a60 0x7ffa3c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 0x7ffa3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 -- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b4005920 msgr2=0x7f45cc14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45b4005920 0x7f45cc14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 -- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45cc0b04a0 msgr2=0x7f45cc159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45cc0b04a0 0x7f45cc159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 -- 172.21.15.33:0/2517879433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0b0fd0 con 0x7f45cc0b0030 2024-08-15T17:53:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- start start 2024-08-15T17:53:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f45cbfff700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc0b0030 0x7f45cc158f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45bc01e040 tx=0x7f45bc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa537fe700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa3c003a60 0x7ffa3c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa52ffd700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 0x7ffa3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 Processor -- start 2024-08-15T17:53:59.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 -- start start 2024-08-15T17:53:59.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f009806e7a0 0x7f009814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00980ab5e0 0x7f0098159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 0x7f00981596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009814a500 con 0x7f00980ab5e0 2024-08-15T17:53:59.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098139f90 con 0x7f0098155310 2024-08-15T17:53:59.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009cbc6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0098150870 con 0x7f009806e7a0 2024-08-15T17:53:59.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 0x7fe0940a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0940a9260 0x7fe0940af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0940af030 con 0x7fe094087890 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0940a96e0 con 0x7fe0940a9260 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09406e1a0 con 0x7fe09406db90 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe092d9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0940a9260 0x7fe0940af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe092d9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0940a9260 0x7fe0940af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55680/0 (socket says 172.21.15.33:55680) 2024-08-15T17:53:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe092d9d700 1 -- 172.21.15.33:0/3368318177 learned_addr learned my addr 172.21.15.33:0/3368318177 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe091d9b700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 0x7fe0940a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551108182 0 0) 0x7fe0940af030 con 0x7fe094087890 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe07c003550 con 0x7fe094087890 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5415dff0 con 0x7ffa3c004d50 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c00ba90 con 0x7ffa3c003a60 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c00bc50 con 0x7ffa540cad40 2024-08-15T17:53:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7ffa53fff700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651393631 0 0) 0x7fe07c003550 con 0x7fe094087890 2024-08-15T17:53:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 msgr2=0x7fe0940a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 0x7fe0940a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 >> v2:172.21.15.105:3300/0 conn(0x7fe0940a9260 msgr2=0x7fe0940af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 --2- 172.21.15.33:0/3368318177 >> v2:172.21.15.105:3300/0 conn(0x7fe0940a9260 0x7fe0940af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09406e480 con 0x7fe094087890 2024-08-15T17:53:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fe088001470 con 0x7fe094087890 2024-08-15T17:53:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 >> v1:172.21.15.33:6789/0 conn(0x7fe094087890 legacy=0x7fe0940ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe07c003d20 0x7fe07c006100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7fe09159a700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07c006700 0x7fe07c008b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 0x7fe07c00b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940a96e0 con 0x7fe07c006700 2024-08-15T17:53:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09406e1a0 con 0x7fe07c003d20 2024-08-15T17:53:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 -- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 msgr2=0x7ffa3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa540cad40 0x7ffa3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 -- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa3c003a60 msgr2=0x7ffa3c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa3c003a60 0x7ffa3c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 -- 172.21.15.33:0/1281294592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c003570 con 0x7ffa3c004d50 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c00bad0 con 0x7fe09406db90 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07c006700 0x7fe07c008b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09259c700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe07c003d20 0x7fe07c006100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe092d9d700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 0x7fe07c00b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f0095d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00980ab5e0 0x7f0098159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f0095d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00980ab5e0 0x7f0098159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35256/0 (socket says 172.21.15.33:35256) 2024-08-15T17:53:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f0095d9b700 1 -- 172.21.15.33:0/630536766 learned_addr learned my addr 172.21.15.33:0/630536766 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.771+0000 7f009659c700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f009806e7a0 0x7f009814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f0095d9b700 1 -- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f009806e7a0 msgr2=0x7f009814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f0095d9b700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f009806e7a0 0x7f009814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f0095d9b700 1 -- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 msgr2=0x7f00981596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f0095d9b700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0098155310 0x7f00981596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f0095d9b700 1 -- 172.21.15.33:0/630536766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088009420 con 0x7f00980ab5e0 2024-08-15T17:53:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f0095d9b700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00980ab5e0 0x7f0098159180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c590 tx=0x7f008c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009c00 tx=0x7ffa440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8657943ba764f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 -- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 msgr2=0x7fe07c00b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09406db90 0x7fe07c00b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 -- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe07c003d20 msgr2=0x7fe07c006100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe07c003d20 0x7fe07c006100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 -- 172.21.15.33:0/3368318177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c003550 con 0x7fe07c006700 2024-08-15T17:53:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe091d9b700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07c006700 0x7fe07c008b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe08400db70 tx=0x7fe08400d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0394430de8db68 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc000d10 con 0x7f45cc0b0030 2024-08-15T17:53:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc013c00 con 0x7f45cc0b0030 2024-08-15T17:53:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc01b690 con 0x7f45cc0b0030 2024-08-15T17:53:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45d2c58700 1 -- 172.21.15.33:0/2517879433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc0979e0 con 0x7f45cc0b0030 2024-08-15T17:53:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400e710 con 0x7ffa3c004d50 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4400e870 con 0x7ffa3c004d50 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa527fc700 1 -- 172.21.15.33:0/1281294592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400ec30 con 0x7ffa3c004d50 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa59aba700 1 -- 172.21.15.33:0/1281294592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa3c004d50 msgr2=0x7ffa3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa59aba700 1 --2- 172.21.15.33:0/1281294592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009c00 tx=0x7ffa440091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011540 con 0x7fe07c006700 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084013070 con 0x7fe07c006700 2024-08-15T17:53:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09159a700 1 -- 172.21.15.33:0/3368318177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0840116c0 con 0x7fe07c006700 2024-08-15T17:53:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c011590 con 0x7f00980ab5e0 2024-08-15T17:53:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0098150b50 con 0x7f00980ab5e0 2024-08-15T17:53:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0098151110 con 0x7f00980ab5e0 2024-08-15T17:53:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45d2c58700 1 -- 172.21.15.33:0/2517879433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc14ec60 con 0x7f45cc0b0030 2024-08-15T17:53:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 Processor -- start 2024-08-15T17:53:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 -- start start 2024-08-15T17:53:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f36b6798700 1 Processor -- start 2024-08-15T17:53:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45d2c58700 1 -- 172.21.15.33:0/2517879433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45cc099f00 con 0x7f45cc0b0030 2024-08-15T17:53:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa53fff700 1 -- 172.21.15.33:0/1281294592 reap_dead start 2024-08-15T17:53:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa59aba700 1 -- 172.21.15.33:0/1281294592 shutdown_connections 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa59aba700 1 -- 172.21.15.33:0/1281294592 >> 172.21.15.33:0/1281294592 conn(0x7ffa54067810 msgr2=0x7ffa54067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa59aba700 1 -- 172.21.15.33:0/1281294592 shutdown_connections 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09359e700 1 -- 172.21.15.33:0/3368318177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07c006700 msgr2=0x7fe07c008b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09359e700 1 --2- 172.21.15.33:0/3368318177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07c006700 0x7fe07c008b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe08400db70 tx=0x7fe08400d1a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe092d9d700 1 -- 172.21.15.33:0/3368318177 reap_dead start 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09359e700 1 -- 172.21.15.33:0/3368318177 shutdown_connections 2024-08-15T17:53:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09359e700 1 -- 172.21.15.33:0/3368318177 >> 172.21.15.33:0/3368318177 conn(0x7fe094066e00 msgr2=0x7fe094067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f36b6798700 1 -- start start 2024-08-15T17:53:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f629c0ade60 0x7f629c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c1580e0 con 0x7f629c0b0d90 2024-08-15T17:53:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0b1720 con 0x7f629c0ade60 2024-08-15T17:53:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f62a12be700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1577b0 con 0x7f629c156d80 2024-08-15T17:53:59.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c0116f0 con 0x7f00980ab5e0 2024-08-15T17:53:59.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c011ab0 con 0x7f00980ab5e0 2024-08-15T17:53:59.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f007ffff700 1 -- 172.21.15.33:0/630536766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0074000fd0 con 0x7f00980ab5e0 2024-08-15T17:53:59.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f629c0ade60 0x7f629c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f629c0ade60 0x7f629c0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55710/0 (socket says 172.21.15.33:55710) 2024-08-15T17:53:59.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 -- 172.21.15.33:0/3127295259 learned_addr learned my addr 172.21.15.33:0/3127295259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b6798700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b013ea80 0x7f36b0160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b6798700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b0156700 con 0x7f36b013e6b0 2024-08-15T17:53:59.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b6798700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b0155af0 con 0x7f36b0155670 2024-08-15T17:53:59.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b6798700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0155dd0 con 0x7f36b013ea80 2024-08-15T17:53:59.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f008c01b3b0 con 0x7f00980ab5e0 2024-08-15T17:53:59.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f45bc022040 con 0x7f45cc0b0030 2024-08-15T17:53:59.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45c8ff9700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45b80609b0 0x7f45b8062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45bc0818e0 con 0x7f45cc0b0030 2024-08-15T17:53:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45c8ff9700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f45b80689d0 0x7f45b806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 --> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45b806b490 con 0x7f45b80689d0 2024-08-15T17:53:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5796700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f36b013e6b0 0x7f36b00b1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46802/0 (socket says 172.21.15.33:46802) 2024-08-15T17:53:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5796700 1 -- 172.21.15.33:0/3145502815 learned_addr learned my addr 172.21.15.33:0/3145502815 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f629bfff700 1 --2- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 Processor -- start 2024-08-15T17:53:59.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 -- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 msgr2=0x7f629c157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 --2- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 -- 172.21.15.33:0/3127295259 >> v1:172.21.15.105:6789/0 conn(0x7f629c0b0d90 legacy=0x7f629c0ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 -- 172.21.15.33:0/3127295259 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c157a90 con 0x7f629c0ade60 2024-08-15T17:53:59.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45d11f5700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f45b80689d0 0x7f45b806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7ffa59aba700 1 -- 172.21.15.33:0/1281294592 wait complete. 2024-08-15T17:53:59.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7ffa59aba700 1 Processor -- start 2024-08-15T17:53:59.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5f97700 1 --2- 172.21.15.33:0/3145502815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b013ea80 0x7f36b0160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36a7fff700 1 -- 172.21.15.33:0/3145502815 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731665791 0 0) 0x7f36b0156700 con 0x7f36b013e6b0 2024-08-15T17:53:59.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36a7fff700 1 -- 172.21.15.33:0/3145502815 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369c003570 con 0x7f36b013e6b0 2024-08-15T17:53:59.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a0abd700 1 --2- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0ade60 0x7f629c0b11e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f628c0099b0 tx=0x7f628c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c345ca5728ba5af0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 -- start start 2024-08-15T17:53:59.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f00867fc700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0080069230 0x7f008006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45bc051d10 con 0x7f45cc0b0030 2024-08-15T17:53:59.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7ffa59aba700 1 -- start start 2024-08-15T17:53:59.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f008c07c120 con 0x7f00980ab5e0 2024-08-15T17:53:59.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45d09f4700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45b80609b0 0x7f45b8062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36a7fff700 1 -- 172.21.15.33:0/3145502815 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014556782 0 0) 0x7f369c003570 con 0x7f36b013e6b0 2024-08-15T17:53:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5f97700 1 -- 172.21.15.33:0/3145502815 >> v1:172.21.15.105:6789/0 conn(0x7f36b0155670 legacy=0x7f36b006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5f97700 1 -- 172.21.15.33:0/3145502815 >> v1:172.21.15.33:6789/0 conn(0x7f36b013e6b0 legacy=0x7f36b00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5f97700 1 -- 172.21.15.33:0/3145502815 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b01560b0 con 0x7f36b013ea80 2024-08-15T17:53:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f00867fc700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7f00800712d0 0x7f00800736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f009659c700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0080069230 0x7f008006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45d11f5700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f45b80689d0 0x7f45b806ade0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f629affd700 1 -- 172.21.15.33:0/3127295259 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00b820 con 0x7f629c0ade60 2024-08-15T17:53:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f0096d9d700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7f00800712d0 0x7f00800736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f629affd700 1 -- 172.21.15.33:0/3127295259 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00b980 con 0x7f629c0ade60 2024-08-15T17:53:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f629affd700 1 -- 172.21.15.33:0/3127295259 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00bd20 con 0x7f629c0ade60 2024-08-15T17:53:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b5f97700 1 --2- 172.21.15.33:0/3145502815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b013ea80 0x7f36b0160040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009910 tx=0x7f36ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661a826c1468a832 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc8f80adf10 0x7fc8f80ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8f80cb450 0x7fc8f806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f80cb870 con 0x7fc8f806e470 2024-08-15T17:53:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f8158290 con 0x7fc8f80cb450 2024-08-15T17:53:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8ff18b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f81610c0 con 0x7fc8f80adf10 2024-08-15T17:53:59.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 --> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0080073d90 con 0x7f00800712d0 2024-08-15T17:53:59.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f008c07e730 con 0x7f00980ab5e0 2024-08-15T17:53:59.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f45d09f4700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45b80609b0 0x7f45b8062e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45cc153530 tx=0x7f45c0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36a7fff700 1 -- 172.21.15.33:0/3145502815 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80017f0 con 0x7f36b013ea80 2024-08-15T17:53:59.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8f7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc8f806e470 0x7fc8f80cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46818/0 (socket says 172.21.15.33:46818) 2024-08-15T17:53:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8f7fff700 1 -- 172.21.15.33:0/802605161 learned_addr learned my addr 172.21.15.33:0/802605161 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:53:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09359e700 1 -- 172.21.15.33:0/3368318177 shutdown_connections 2024-08-15T17:53:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.775+0000 7fe09359e700 1 -- 172.21.15.33:0/3368318177 wait complete. 2024-08-15T17:53:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36a7fff700 1 -- 172.21.15.33:0/3145502815 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac011420 con 0x7f36b013ea80 2024-08-15T17:53:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36a7fff700 1 -- 172.21.15.33:0/3145502815 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0117a0 con 0x7f36b013ea80 2024-08-15T17:53:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 Processor -- start 2024-08-15T17:53:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 -- start start 2024-08-15T17:53:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0940c26e0 0x7fe094168bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0940c16b0 0x7fe0940c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09415e270 0x7fe09415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09417d5b0 con 0x7fe0940c26e0 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0941665b0 con 0x7fe0940c16b0 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe094166890 con 0x7fe09415e270 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0940c26e0 0x7fe094168bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0940c26e0 0x7fe094168bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35304/0 (socket says 172.21.15.33:35304) 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 -- 172.21.15.33:0/2310291724 learned_addr learned my addr 172.21.15.33:0/2310291724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe092d9d700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09415e270 0x7fe09415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fcf27700 1 --2- 172.21.15.33:0/802605161 >> v2:172.21.15.105:3300/0 conn(0x7fc8f80adf10 0x7fc8f80ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe091d9b700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0940c16b0 0x7fe0940c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 -- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09415e270 msgr2=0x7fe09415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09415e270 0x7fe09415e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 -- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0940c16b0 msgr2=0x7fe0940c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0940c16b0 0x7fe0940c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 -- 172.21.15.33:0/2310291724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0940c2ff0 con 0x7fe0940c26e0 2024-08-15T17:53:59.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe092d9d700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09415e270 0x7fe09415e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:53:59.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f009659c700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0080069230 0x7f008006b6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00980685a0 tx=0x7f008801b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a12be700 1 -- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0ade60 msgr2=0x7f629c0b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a12be700 1 --2- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0ade60 0x7f629c0b11e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f628c0099b0 tx=0x7f628c009250 comp rx=0 tx=0).stop 2024-08-15T17:53:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fd728700 1 --2- 172.21.15.33:0/802605161 >> v2:172.21.15.33:3300/0 conn(0x7fc8f80cb450 0x7fc8f806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a12be700 1 -- 172.21.15.33:0/3127295259 shutdown_connections 2024-08-15T17:53:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a12be700 1 --2- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0ade60 0x7f629c0b11e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a12be700 1 --2- 172.21.15.33:0/3127295259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f62a12be700 1 -- 172.21.15.33:0/3127295259 >> 172.21.15.33:0/3127295259 conn(0x7f629c0678d0 msgr2=0x7f629c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f0096d9d700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7f00800712d0 0x7f00800736e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe09259c700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0940c26e0 0x7fe094168bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe08800fd60 tx=0x7fe09406ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fbf1937e700 1 Processor -- start 2024-08-15T17:53:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fd728700 1 -- 172.21.15.33:0/802605161 >> v2:172.21.15.105:3300/0 conn(0x7fc8f80adf10 msgr2=0x7fc8f80ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:53:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fd728700 1 --2- 172.21.15.33:0/802605161 >> v2:172.21.15.105:3300/0 conn(0x7fc8f80adf10 0x7fc8f80ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fd728700 1 -- 172.21.15.33:0/802605161 >> v1:172.21.15.33:6789/0 conn(0x7fc8f806e470 legacy=0x7fc8f80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fd728700 1 -- 172.21.15.33:0/802605161 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80ae820 con 0x7fc8f80cb450 2024-08-15T17:53:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fc8fcf27700 1 --2- 172.21.15.33:0/802605161 >> v2:172.21.15.105:3300/0 conn(0x7fc8f80adf10 0x7fc8f80ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:53:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b6798700 1 -- 172.21.15.33:0/3145502815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b013ea80 msgr2=0x7f36b0160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7f36b6798700 1 --2- 172.21.15.33:0/3145502815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b013ea80 0x7f36b0160040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009910 tx=0x7f36ac0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.779+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880014e0 con 0x7fe0940c26e0 2024-08-15T17:53:59.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 -- 172.21.15.33:0/3127295259 shutdown_connections 2024-08-15T17:53:59.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800dbe0 con 0x7fe0940c26e0 2024-08-15T17:53:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09417d800 con 0x7fe0940c26e0 2024-08-15T17:53:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088014470 con 0x7fe0940c26e0 2024-08-15T17:53:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f36b6798700 1 -- 172.21.15.33:0/3145502815 shutdown_connections 2024-08-15T17:53:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f36b6798700 1 --2- 172.21.15.33:0/3145502815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b013ea80 0x7f36b0160040 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f36b6798700 1 -- 172.21.15.33:0/3145502815 >> 172.21.15.33:0/3145502815 conn(0x7f36b00678d0 msgr2=0x7f36b0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0940c1b00 con 0x7fe0940c26e0 2024-08-15T17:53:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa54144560 0x7ffa54098670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 -- 172.21.15.33:0/3127295259 wait complete. 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa54144930 0x7ffa540969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa54096f30 0x7ffa54098f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540973a0 con 0x7ffa54144560 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540981e0 con 0x7ffa54144930 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54155890 con 0x7ffa54096f30 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa53fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa54096f30 0x7ffa54098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== osd.6 v2:172.21.15.105:6816/24430 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f45b806b490 con 0x7f45b80689d0 2024-08-15T17:53:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== osd.3 v2:172.21.15.33:6816/24181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0080073d90 con 0x7f00800712d0 2024-08-15T17:53:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f36b6798700 1 -- 172.21.15.33:0/3145502815 shutdown_connections 2024-08-15T17:53:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0940643a0 con 0x7fe0940c26e0 2024-08-15T17:53:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa53fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa54096f30 0x7ffa54098f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:59974/0 (socket says 172.21.15.33:59974) 2024-08-15T17:53:59.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa53fff700 1 -- 172.21.15.33:0/508711042 learned_addr learned my addr 172.21.15.33:0/508711042 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f36b6798700 1 -- 172.21.15.33:0/3145502815 wait complete. 2024-08-15T17:53:59.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa54144560 0x7ffa54098670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fc8fd728700 1 --2- 172.21.15.33:0/802605161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f80cb450 0x7fc8f806e910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc8f806fbc0 tx=0x7fc8e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76357e318b3fe0a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf1937e700 1 -- start start 2024-08-15T17:53:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf1937e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbf1414fc20 0x7fbf14156200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf1937e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbf140ae5d0 0x7fbf140aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 Processor -- start 2024-08-15T17:53:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 -- start start 2024-08-15T17:53:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf1937e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf14069a40 con 0x7fbf1414f850 2024-08-15T17:53:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf1937e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf14069d20 con 0x7fbf1414fc20 2024-08-15T17:53:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf1937e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1406a000 con 0x7fbf140ae5d0 2024-08-15T17:53:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbf140ae5d0 0x7fbf140aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbf140ae5d0 0x7fbf140aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55724/0 (socket says 172.21.15.33:55724) 2024-08-15T17:53:59.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 -- 172.21.15.33:0/2976233076 learned_addr learned my addr 172.21.15.33:0/2976233076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f36b6798700 1 Processor -- start 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa52ffd700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa54144930 0x7ffa540969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 -- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa54096f30 msgr2=0x7ffa54098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa54096f30 0x7ffa54098f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 -- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa54144930 msgr2=0x7ffa540969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa54144930 0x7ffa540969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 -- 172.21.15.33:0/508711042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540975d0 con 0x7ffa54144560 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa537fe700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa54144560 0x7ffa54098670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c002250 tx=0x7ffa4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0133f0 con 0x7ffa54144560 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c013570 con 0x7ffa54144560 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540978b0 con 0x7ffa54144560 2024-08-15T17:53:59.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c013930 con 0x7ffa54144560 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa54097e70 con 0x7ffa54144560 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f629c0ade60 0x7f629c0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0b0d90 0x7f629c0a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c1794f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c176ec0 con 0x7f629c0ade60 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c176620 con 0x7f629c0b0d90 2024-08-15T17:53:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a12be700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c176900 con 0x7f629c156d80 2024-08-15T17:53:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 -- 172.21.15.33:0/2976233076 >> v2:172.21.15.33:3300/0 conn(0x7fbf1414fc20 msgr2=0x7fbf14156200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-15T17:53:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 --2- 172.21.15.33:0/2976233076 >> v2:172.21.15.33:3300/0 conn(0x7fbf1414fc20 0x7fbf14156200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 -- 172.21.15.33:0/2976233076 >> v1:172.21.15.105:6789/0 conn(0x7fbf1414f850 legacy=0x7fbf140691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 -- 172.21.15.33:0/2976233076 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14155ce0 con 0x7fbf140ae5d0 2024-08-15T17:53:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fbf137fe700 1 --2- 172.21.15.33:0/2976233076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 0x7fbf140aa440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009320 tx=0x7fbf04009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26d92dc65d6b193 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fc8f77fe700 1 -- 172.21.15.33:0/802605161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011630 con 0x7fc8f80cb450 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fc8f77fe700 1 -- 172.21.15.33:0/802605161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8011790 con 0x7fc8f80cb450 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fc8f77fe700 1 -- 172.21.15.33:0/802605161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011b30 con 0x7fc8f80cb450 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f629b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0b0d90 0x7f629c0a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a0abd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c1794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a0abd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c1794f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:59976/0 (socket says 172.21.15.33:59976) 2024-08-15T17:53:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7f62a0abd700 1 -- 172.21.15.33:0/3095844759 learned_addr learned my addr 172.21.15.33:0/3095844759 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.783+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe0880148a0 con 0x7fe0940c26e0 2024-08-15T17:53:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f629b7fe700 1 -- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 msgr2=0x7f629c1794f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f629b7fe700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629c156d80 0x7f629c1794f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f629b7fe700 1 -- 172.21.15.33:0/3095844759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f629c0ade60 msgr2=0x7f629c0aaf40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-15T17:53:59.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f629b7fe700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f629c0ade60 0x7f629c0aaf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f629b7fe700 1 -- 172.21.15.33:0/3095844759 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0094f0 con 0x7f629c0b0d90 2024-08-15T17:53:59.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe0827fc700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe0740609e0 0x7fe074062e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa540645c0 con 0x7ffa54144560 2024-08-15T17:53:59.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa4c013ca0 con 0x7ffa54144560 2024-08-15T17:53:59.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa3b7fe700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ffa40060930 0x7ffa40062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa4c0863a0 con 0x7ffa54144560 2024-08-15T17:53:59.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa3b7fe700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7ffa40068b40 0x7ffa4006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 --> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa4006b600 con 0x7ffa40068b40 2024-08-15T17:53:59.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa4c086600 con 0x7ffa54144560 2024-08-15T17:53:59.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa52ffd700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ffa40060930 0x7ffa40062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe08807d6c0 con 0x7fe0940c26e0 2024-08-15T17:53:59.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe091d9b700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe0740609e0 0x7fe074062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe0827fc700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe074068a80 0x7fe07406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 --> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe07406b540 con 0x7fe074068a80 2024-08-15T17:53:59.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe08807fc60 con 0x7fe0940c26e0 2024-08-15T17:53:59.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe091d9b700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe0740609e0 0x7fe074062e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe094066190 tx=0x7fe084016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 -- start start 2024-08-15T17:53:59.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf11ffb700 1 -- 172.21.15.33:0/2976233076 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400c930 con 0x7fbf140ae5d0 2024-08-15T17:53:59.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf11ffb700 1 -- 172.21.15.33:0/2976233076 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400ca90 con 0x7fbf140ae5d0 2024-08-15T17:53:59.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf11ffb700 1 -- 172.21.15.33:0/2976233076 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400ce30 con 0x7fbf140ae5d0 2024-08-15T17:53:59.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 -- 172.21.15.33:0/2976233076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 msgr2=0x7fbf140aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 --2- 172.21.15.33:0/2976233076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 0x7fbf140aa440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009320 tx=0x7fbf04009ae0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 -- 172.21.15.33:0/2976233076 shutdown_connections 2024-08-15T17:53:59.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 --2- 172.21.15.33:0/2976233076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 0x7fbf140aa440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 --2- 172.21.15.33:0/2976233076 >> v2:172.21.15.33:3300/0 conn(0x7fbf1414fc20 0x7fbf14156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 -- 172.21.15.33:0/2976233076 >> 172.21.15.33:0/2976233076 conn(0x7fbf14068300 msgr2=0x7fbf140a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 -- 172.21.15.33:0/2976233076 shutdown_connections 2024-08-15T17:53:59.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 -- 172.21.15.33:0/2976233076 wait complete. 2024-08-15T17:53:59.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 -- 172.21.15.33:0/802605161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f80cb450 msgr2=0x7fc8f806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 --2- 172.21.15.33:0/802605161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f80cb450 0x7fc8f806e910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc8f806fbc0 tx=0x7fc8e80091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 -- 172.21.15.33:0/802605161 shutdown_connections 2024-08-15T17:53:59.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 --2- 172.21.15.33:0/802605161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f80cb450 0x7fc8f806e910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 --2- 172.21.15.33:0/802605161 >> v2:172.21.15.105:3300/0 conn(0x7fc8f80adf10 0x7fc8f80ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 -- 172.21.15.33:0/802605161 >> 172.21.15.33:0/802605161 conn(0x7fc8f8067810 msgr2=0x7fc8f8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 -- 172.21.15.33:0/802605161 shutdown_connections 2024-08-15T17:53:59.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 -- 172.21.15.33:0/802605161 wait complete. 2024-08-15T17:53:59.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f629b7fe700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0b0d90 0x7f629c0a8670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f629000c4e0 tx=0x7f6290007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011590 con 0x7f629c0b0d90 2024-08-15T17:53:59.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6290011710 con 0x7f629c0b0d90 2024-08-15T17:53:59.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe092d9d700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe074068a80 0x7fe07406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36b013e6b0 0x7f36b00c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b013ea80 0x7f36b01334e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b01352c0 0x7f36b01402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b013fe20 con 0x7f36b013e6b0 2024-08-15T17:53:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b013f800 con 0x7f36b013ea80 2024-08-15T17:53:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b6798700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0135730 con 0x7f36b01352c0 2024-08-15T17:53:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b013ea80 0x7f36b01334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b013ea80 0x7f36b01334e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55738/0 (socket says 172.21.15.33:55738) 2024-08-15T17:53:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 -- 172.21.15.33:0/1512304679 learned_addr learned my addr 172.21.15.33:0/1512304679 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 Processor -- start 2024-08-15T17:53:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b5796700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36b013e6b0 0x7f36b00c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 -- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b01352c0 msgr2=0x7f36b01402b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-15T17:53:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b01352c0 0x7f36b01402b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 -- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36b013e6b0 msgr2=0x7f36b00c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36b013e6b0 0x7f36b00c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 -- 172.21.15.33:0/1512304679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009420 con 0x7f36b013ea80 2024-08-15T17:53:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 Processor -- start 2024-08-15T17:53:59.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fc8ff18b700 1 -- start start 2024-08-15T17:53:59.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fe092d9d700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe074068a80 0x7fe07406ae90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7fbf1937e700 1 -- start start 2024-08-15T17:53:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa53fff700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7ffa40068b40 0x7ffa4006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa52ffd700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ffa40060930 0x7ffa40062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b0b0 tx=0x7ffa4800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b5796700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36b013e6b0 0x7f36b00c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:53:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7ffa53fff700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7ffa40068b40 0x7ffa4006af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011ad0 con 0x7f629c0b0d90 2024-08-15T17:53:59.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c176be0 con 0x7f629c0b0d90 2024-08-15T17:53:59.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c0a8bb0 con 0x7f629c0b0d90 2024-08-15T17:53:59.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.787+0000 7f36b4f95700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b013ea80 0x7f36b01334e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c590 tx=0x7f36a000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0011590 con 0x7f36b013ea80 2024-08-15T17:53:59.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a00116f0 con 0x7f36b013ea80 2024-08-15T17:53:59.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0011ab0 con 0x7f36b013ea80 2024-08-15T17:53:59.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b0135a10 con 0x7f36b013ea80 2024-08-15T17:53:59.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b00c9360 con 0x7f36b013ea80 2024-08-15T17:53:59.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== osd.1 v2:172.21.15.33:6801/24182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe07406b540 con 0x7fe074068a80 2024-08-15T17:53:59.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 0x7fbf140b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf1414f850 0x7fbf14177570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1414fc20 0x7fbf14152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14176cf0 con 0x7fbf1414f850 2024-08-15T17:53:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14176fd0 con 0x7fbf140ae5d0 2024-08-15T17:53:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141772b0 con 0x7fbf1414fc20 2024-08-15T17:53:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf1414f850 0x7fbf14177570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf1414f850 0x7fbf14177570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35326/0 (socket says 172.21.15.33:35326) 2024-08-15T17:53:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 -- 172.21.15.33:0/14680778 learned_addr learned my addr 172.21.15.33:0/14680778 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f629c0643a0 con 0x7f629c0b0d90 2024-08-15T17:53:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f806e470 0x7fc8f80af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f80adf10 0x7fc8f8157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f80cb450 0x7fc8f80a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80afdd0 con 0x7fc8f806e470 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80aaf80 con 0x7fc8f80adf10 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8159860 con 0x7fc8f80cb450 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8fcf27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f806e470 0x7fc8f80af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8fcf27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f806e470 0x7fc8f80af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35334/0 (socket says 172.21.15.33:35334) 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8fcf27700 1 -- 172.21.15.33:0/966222323 learned_addr learned my addr 172.21.15.33:0/966222323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f80adf10 0x7fc8f8157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 -- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f80cb450 msgr2=0x7fc8f80a8d20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f80cb450 0x7fc8f80a8d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 -- 172.21.15.33:0/966222323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f806e470 msgr2=0x7fc8f80af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8f806e470 0x7fc8f80af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 -- 172.21.15.33:0/966222323 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec009420 con 0x7fc8f80adf10 2024-08-15T17:53:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf137fe700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1414fc20 0x7fbf14152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 -- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1414fc20 msgr2=0x7fbf14152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1414fc20 0x7fbf14152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 -- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 msgr2=0x7fbf140b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf140ae5d0 0x7fbf140b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 -- 172.21.15.33:0/14680778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04009d80 con 0x7fbf1414f850 2024-08-15T17:53:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36b00643a0 con 0x7f36b013ea80 2024-08-15T17:53:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f7fff700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f80adf10 0x7fc8f8157040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000cd70 tx=0x7fc8f0001b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf127fc700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf1414f850 0x7fbf14177570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800b5e0 tx=0x7fbf080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800f510 con 0x7fbf1414f850 2024-08-15T17:53:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800f670 con 0x7fbf1414f850 2024-08-15T17:53:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800fa30 con 0x7fbf1414f850 2024-08-15T17:53:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf14152220 con 0x7fbf1414f850 2024-08-15T17:53:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf140b15e0 con 0x7fbf1414f850 2024-08-15T17:53:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000ab30 con 0x7fc8f80adf10 2024-08-15T17:53:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000ac90 con 0x7fc8f80adf10 2024-08-15T17:53:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e8009420 con 0x7fc8f80adf10 2024-08-15T17:53:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0007340 con 0x7fc8f80adf10 2024-08-15T17:53:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f8159de0 con 0x7fc8f80adf10 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f629001c460 con 0x7f629c0b0d90 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f6283fff700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6288060860 0x7f6288062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f629007cd30 con 0x7f629c0b0d90 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f6283fff700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f6288068880 0x7f628806ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 --> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f628806b340 con 0x7f6288068880 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f629007d100 con 0x7f629c0b0d90 2024-08-15T17:53:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f629bfff700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6288060860 0x7f6288062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f36a0033ad0 con 0x7f36b013ea80 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3694060930 0x7f3694062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36a007c250 con 0x7f36b013ea80 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f3694068b40 0x7f369406af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 --> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f369406b600 con 0x7f3694068b40 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.791+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36a007c620 con 0x7f36b013ea80 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f36b5796700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3694060930 0x7f3694062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f36b5f97700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f3694068b40 0x7f369406af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f62a0abd700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f6288068880 0x7f628806ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f629bfff700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6288060860 0x7f6288062d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6294009fd0 tx=0x7f6294009970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f36b5f97700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f3694068b40 0x7f369406af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8d8000fd0 con 0x7fc8f80adf10 2024-08-15T17:53:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf140645c0 con 0x7fbf1414f850 2024-08-15T17:53:59.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f62a0abd700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f6288068880 0x7f628806ac90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f36b5796700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3694060930 0x7f3694062de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36a8001560 tx=0x7f36a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbf0801a400 con 0x7fbf1414f850 2024-08-15T17:53:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== osd.2 v2:172.21.15.33:6824/24191 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f369406b600 con 0x7f3694068b40 2024-08-15T17:53:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== osd.0 v2:172.21.15.33:6800/24180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ffa4006b600 con 0x7ffa40068b40 2024-08-15T17:53:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbefaffd700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbf000608e0 0x7fbf00062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf0807c6b0 con 0x7fbf1414f850 2024-08-15T17:53:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc8f0007770 con 0x7fc8f80adf10 2024-08-15T17:53:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8f4ff9700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc8e40609b0 0x7fc8e4062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8f007d080 con 0x7fc8f80adf10 2024-08-15T17:53:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8fcf27700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc8e40609b0 0x7fc8e4062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8f4ff9700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7fc8e4068b40 0x7fc8e406af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 --> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8e406b600 con 0x7fc8e4068b40 2024-08-15T17:53:59.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== osd.7 v2:172.21.15.105:6808/24464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f628806b340 con 0x7f6288068880 2024-08-15T17:53:59.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8fd728700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7fc8e4068b40 0x7fc8e406af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8fcf27700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc8e40609b0 0x7fc8e4062e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec011310 tx=0x7fc8ec0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fc8fd728700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7fc8e4068b40 0x7fc8e406af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbefaffd700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7fbf00068a70 0x7fbf0006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 --> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf0006b530 con 0x7fbf00068a70 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf0804cae0 con 0x7fbf1414f850 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbf137fe700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7fbf00068a70 0x7fbf0006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbf12ffd700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbf000608e0 0x7fbf00062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbf12ffd700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbf000608e0 0x7fbf00062d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c001d90 tx=0x7fbf0c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.795+0000 7fbf137fe700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7fbf00068a70 0x7fbf0006ae80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:53:59.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.799+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8f004d530 con 0x7fc8f80adf10 2024-08-15T17:53:59.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.799+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== osd.4 v2:172.21.15.105:6824/24428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbf0006b530 con 0x7fbf00068a70 2024-08-15T17:53:59.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.799+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== osd.5 v2:172.21.15.105:6800/24429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc8e406b600 con 0x7fc8e4068b40 2024-08-15T17:53:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.811+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 --> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe09406a4b0 con 0x7fe074068a80 2024-08-15T17:53:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.811+0000 7f45d2c58700 1 -- 172.21.15.33:0/2517879433 --> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f45cc0645c0 con 0x7f45b80689d0 2024-08-15T17:53:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.811+0000 7fe0827fc700 1 -- 172.21.15.33:0/2310291724 <== osd.1 v2:172.21.15.33:6801/24182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe09406a4b0 con 0x7fe074068a80 2024-08-15T17:53:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.811+0000 7f45c8ff9700 1 -- 172.21.15.33:0/2517879433 <== osd.6 v2:172.21.15.105:6816/24430 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f45cc0645c0 con 0x7f45b80689d0 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe074068a80 msgr2=0x7fe07406ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe074068a80 0x7fe07406ae90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe0740609e0 msgr2=0x7fe074062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe0740609e0 0x7fe074062e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe094066190 tx=0x7fe084016000 comp rx=0 tx=0).stop 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0940c26e0 msgr2=0x7fe094168bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 --2- 172.21.15.33:0/2310291724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0940c26e0 0x7fe094168bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe08800fd60 tx=0x7fe09406ed20 comp rx=0 tx=0).stop 2024-08-15T17:53:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe092d9d700 1 -- 172.21.15.33:0/2310291724 reap_dead start 2024-08-15T17:53:59.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 shutdown_connections 2024-08-15T17:53:59.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 >> 172.21.15.33:0/2310291724 conn(0x7fe094066e00 msgr2=0x7fe0940ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 shutdown_connections 2024-08-15T17:53:59.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7fe09359e700 1 -- 172.21.15.33:0/2310291724 wait complete. 2024-08-15T17:53:59.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 --> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36b013f940 con 0x7f3694068b40 2024-08-15T17:53:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.815+0000 7f36a57fa700 1 -- 172.21.15.33:0/1512304679 <== osd.2 v2:172.21.15.33:6824/24191 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36b013f940 con 0x7f3694068b40 2024-08-15T17:53:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f3694068b40 msgr2=0x7f369406af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f3694068b40 0x7f369406af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f007ffff700 1 -- 172.21.15.33:0/630536766 --> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0074002d30 con 0x7f00800712d0 2024-08-15T17:53:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3694060930 msgr2=0x7f3694062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3694060930 0x7f3694062de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36a8001560 tx=0x7f36a8009040 comp rx=0 tx=0).stop 2024-08-15T17:53:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b013ea80 msgr2=0x7f36b01334e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 --2- 172.21.15.33:0/1512304679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b013ea80 0x7f36b01334e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c590 tx=0x7f36a000c950 comp rx=0 tx=0).stop 2024-08-15T17:53:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b5f97700 1 -- 172.21.15.33:0/1512304679 reap_dead start 2024-08-15T17:53:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f00867fc700 1 -- 172.21.15.33:0/630536766 <== osd.3 v2:172.21.15.33:6816/24181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0074002d30 con 0x7f00800712d0 2024-08-15T17:53:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 shutdown_connections 2024-08-15T17:53:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 >> 172.21.15.33:0/1512304679 conn(0x7f36b00678d0 msgr2=0x7f36b0157540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 shutdown_connections 2024-08-15T17:53:59.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.819+0000 7f36b6798700 1 -- 172.21.15.33:0/1512304679 wait complete. 2024-08-15T17:53:59.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 --> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa5406efa0 con 0x7ffa40068b40 2024-08-15T17:53:59.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f45b80689d0 msgr2=0x7f45b806ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f45b80689d0 0x7f45b806ade0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7f00800712d0 msgr2=0x7f00800736e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7f00800712d0 0x7f00800736e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45b80609b0 msgr2=0x7f45b8062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45b80609b0 0x7f45b8062e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45cc153530 tx=0x7f45c0007d30 comp rx=0 tx=0).stop 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc0b0030 msgr2=0x7f45cc158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 --2- 172.21.15.33:0/2517879433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc0b0030 0x7f45cc158f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45bc01e040 tx=0x7f45bc01b000 comp rx=0 tx=0).stop 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45d11f5700 1 -- 172.21.15.33:0/2517879433 reap_dead start 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 shutdown_connections 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 >> 172.21.15.33:0/2517879433 conn(0x7f45cc068300 msgr2=0x7f45cc157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa3b7fe700 1 -- 172.21.15.33:0/508711042 <== osd.0 v2:172.21.15.33:6800/24180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa5406efa0 con 0x7ffa40068b40 2024-08-15T17:53:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 shutdown_connections 2024-08-15T17:53:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0080069230 msgr2=0x7f008006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0080069230 0x7f008006b6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00980685a0 tx=0x7f008801b000 comp rx=0 tx=0).stop 2024-08-15T17:53:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00980ab5e0 msgr2=0x7f0098159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 --2- 172.21.15.33:0/630536766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00980ab5e0 0x7f0098159180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c590 tx=0x7f008c00c950 comp rx=0 tx=0).stop 2024-08-15T17:53:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f0096d9d700 1 -- 172.21.15.33:0/630536766 reap_dead start 2024-08-15T17:53:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 shutdown_connections 2024-08-15T17:53:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 >> 172.21.15.33:0/630536766 conn(0x7f0098067890 msgr2=0x7f0098158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f45b27fc700 1 -- 172.21.15.33:0/2517879433 wait complete. 2024-08-15T17:53:59.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 shutdown_connections 2024-08-15T17:53:59.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7f009cbc6700 1 -- 172.21.15.33:0/630536766 wait complete. 2024-08-15T17:53:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7ffa40068b40 msgr2=0x7ffa4006af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7ffa40068b40 0x7ffa4006af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ffa40060930 msgr2=0x7ffa40062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ffa40060930 0x7ffa40062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b0b0 tx=0x7ffa4800b040 comp rx=0 tx=0).stop 2024-08-15T17:53:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa54144560 msgr2=0x7ffa54098670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 --2- 172.21.15.33:0/508711042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa54144560 0x7ffa54098670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c002250 tx=0x7ffa4c00a060 comp rx=0 tx=0).stop 2024-08-15T17:53:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa53fff700 1 -- 172.21.15.33:0/508711042 reap_dead start 2024-08-15T17:53:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 shutdown_connections 2024-08-15T17:53:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 >> 172.21.15.33:0/508711042 conn(0x7ffa54067810 msgr2=0x7ffa540b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 shutdown_connections 2024-08-15T17:53:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.823+0000 7ffa59aba700 1 -- 172.21.15.33:0/508711042 wait complete. 2024-08-15T17:53:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 --> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8d8002d30 con 0x7fc8e4068b40 2024-08-15T17:53:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fc8f4ff9700 1 -- 172.21.15.33:0/966222323 <== osd.5 v2:172.21.15.105:6800/24429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8d8002d30 con 0x7fc8e4068b40 2024-08-15T17:53:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 --> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf1406d2a0 con 0x7fbf00068a70 2024-08-15T17:53:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbefaffd700 1 -- 172.21.15.33:0/14680778 <== osd.4 v2:172.21.15.105:6824/24428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf1406d2a0 con 0x7fbf00068a70 2024-08-15T17:53:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7fbf00068a70 msgr2=0x7fbf0006ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7fbf00068a70 0x7fbf0006ae80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbf000608e0 msgr2=0x7fbf00062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbf000608e0 0x7fbf00062d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c001d90 tx=0x7fbf0c007ec0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf1414f850 msgr2=0x7fbf14177570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf1937e700 1 --2- 172.21.15.33:0/14680778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf1414f850 0x7fbf14177570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800b5e0 tx=0x7fbf080091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.827+0000 7fbf137fe700 1 -- 172.21.15.33:0/14680778 reap_dead start 2024-08-15T17:53:59.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7fc8e4068b40 msgr2=0x7fc8e406af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7fc8e4068b40 0x7fc8e406af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc8e40609b0 msgr2=0x7fc8e4062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc8e40609b0 0x7fc8e4062e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec011310 tx=0x7fc8ec0091a0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f80adf10 msgr2=0x7fc8f8157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 --2- 172.21.15.33:0/966222323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f80adf10 0x7fc8f8157040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000cd70 tx=0x7fc8f0001b30 comp rx=0 tx=0).stop 2024-08-15T17:53:59.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8fd728700 1 -- 172.21.15.33:0/966222323 reap_dead start 2024-08-15T17:53:59.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 shutdown_connections 2024-08-15T17:53:59.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 >> 172.21.15.33:0/966222323 conn(0x7fc8f8067810 msgr2=0x7fc8f815efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 shutdown_connections 2024-08-15T17:53:59.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7fc8ff18b700 1 -- 172.21.15.33:0/966222323 wait complete. 2024-08-15T17:53:59.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 --> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f629c06f5f0 con 0x7f6288068880 2024-08-15T17:53:59.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.831+0000 7f6283fff700 1 -- 172.21.15.33:0/3095844759 <== osd.7 v2:172.21.15.105:6808/24464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f629c06f5f0 con 0x7f6288068880 2024-08-15T17:53:59.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.835+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 shutdown_connections 2024-08-15T17:53:59.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.835+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 >> 172.21.15.33:0/14680778 conn(0x7fbf14068300 msgr2=0x7fbf14154b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.835+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 shutdown_connections 2024-08-15T17:53:59.907 INFO:teuthology.orchestra.run.smithi033.stdout:64424509448 2024-08-15T17:53:59.908 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-15T17:53:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.835+0000 7fbf1937e700 1 -- 172.21.15.33:0/14680778 wait complete. 2024-08-15T17:53:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.835+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f6288068880 msgr2=0x7f628806ac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.835+0000 7f62a12be700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f6288068880 0x7f628806ac90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.910 INFO:teuthology.orchestra.run.smithi033.stdout:64424509449 2024-08-15T17:53:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6288060860 msgr2=0x7f6288062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6288060860 0x7f6288062d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6294009fd0 tx=0x7f6294009970 comp rx=0 tx=0).stop 2024-08-15T17:53:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0b0d90 msgr2=0x7f629c0a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:53:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 --2- 172.21.15.33:0/3095844759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629c0b0d90 0x7f629c0a8670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f629000c4e0 tx=0x7f6290007ea0 comp rx=0 tx=0).stop 2024-08-15T17:53:59.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-15T17:53:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a0abd700 1 -- 172.21.15.33:0/3095844759 reap_dead start 2024-08-15T17:53:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 shutdown_connections 2024-08-15T17:53:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 >> 172.21.15.33:0/3095844759 conn(0x7f629c0678d0 msgr2=0x7f629c069c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:53:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 shutdown_connections 2024-08-15T17:53:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:53:59.839+0000 7f62a12be700 1 -- 172.21.15.33:0/3095844759 wait complete. 2024-08-15T17:53:59.913 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:53:59.914 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-15T17:53:59.914 INFO:teuthology.orchestra.run.smithi033.stdout:60129542153 2024-08-15T17:53:59.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-15T17:53:59.915 INFO:teuthology.orchestra.run.smithi033.stdout:64424509449 2024-08-15T17:53:59.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-15T17:53:59.916 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:53:59.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-15T17:53:59.917 INFO:teuthology.orchestra.run.smithi033.stdout:60129542151 2024-08-15T17:53:59.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-15T17:53:59.919 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:53:59.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-15T17:54:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 Processor -- start 2024-08-15T17:54:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 -- start start 2024-08-15T17:54:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a9e4c0700 1 Processor -- start 2024-08-15T17:54:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a9e4c0700 1 -- start start 2024-08-15T17:54:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a40158fb0 0x7f1a400aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a4006e620 0x7f1a400ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a400ab2d0 con 0x7f1a4015d910 2024-08-15T17:54:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a400ab5b0 con 0x7f1a40158fb0 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a44995700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a400ab890 con 0x7f1a4006e620 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a40158fb0 0x7f1a400aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a40158fb0 0x7f1a400aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35344/0 (socket says 172.21.15.33:35344) 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 -- 172.21.15.33:0/2713664657 learned_addr learned my addr 172.21.15.33:0/2713664657 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3ffff700 1 --2- 172.21.15.33:0/2713664657 >> v2:172.21.15.105:3300/0 conn(0x7f1a4006e620 0x7f1a400ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 -- 172.21.15.33:0/2713664657 >> v2:172.21.15.105:3300/0 conn(0x7f1a4006e620 msgr2=0x7f1a400ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 --2- 172.21.15.33:0/2713664657 >> v2:172.21.15.105:3300/0 conn(0x7f1a4006e620 0x7f1a400ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 -- 172.21.15.33:0/2713664657 >> v1:172.21.15.33:6789/0 conn(0x7f1a4015d910 legacy=0x7f1a4006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 -- 172.21.15.33:0/2713664657 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400abb70 con 0x7f1a40158fb0 2024-08-15T17:54:00.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a9e4c0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 0x7f9a9815a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3f7fe700 1 --2- 172.21.15.33:0/2713664657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 0x7f1a400aaa80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a4006ce90 tx=0x7f1a38009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f08a6b3c5d0aa4b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a97fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 0x7f9a9815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f4ee8000700 1 Processor -- start 2024-08-15T17:54:00.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3e7fc700 1 -- 172.21.15.33:0/2713664657 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800e070 con 0x7f1a40158fb0 2024-08-15T17:54:00.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f1a3e7fc700 1 -- 172.21.15.33:0/2713664657 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800b9e0 con 0x7f1a40158fb0 2024-08-15T17:54:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a97fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 0x7f9a9815a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:60010/0 (socket says 172.21.15.33:60010) 2024-08-15T17:54:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a3e7fc700 1 -- 172.21.15.33:0/2713664657 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380092e0 con 0x7f1a40158fb0 2024-08-15T17:54:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a97fff700 1 -- 172.21.15.33:0/65122104 learned_addr learned my addr 172.21.15.33:0/65122104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980acae0 con 0x7f9a9815a8b0 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980ac650 con 0x7f9a980aab50 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98159780 con 0x7f9a981593b0 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62114720 0 0) 0x7f9a980acae0 con 0x7f9a9815a8b0 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a80003570 con 0x7f9a9815a8b0 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642228553 0 0) 0x7f9a980ac650 con 0x7f9a980aab50 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a980acae0 con 0x7f9a980aab50 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a97fff700 1 -- 172.21.15.33:0/65122104 >> v1:172.21.15.105:6789/0 conn(0x7f9a980aab50 legacy=0x7f9a980b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.107+0000 7f4ee8000700 1 -- start start 2024-08-15T17:54:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090403824 0 0) 0x7f9a80003570 con 0x7f9a9815a8b0 2024-08-15T17:54:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a97fff700 1 -- 172.21.15.33:0/65122104 >> v1:172.21.15.33:6789/0 conn(0x7f9a9815a8b0 legacy=0x7f9a980aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a97fff700 1 -- 172.21.15.33:0/65122104 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980aba40 con 0x7f9a981593b0 2024-08-15T17:54:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 -- 172.21.15.33:0/2713664657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 msgr2=0x7f1a400aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 --2- 172.21.15.33:0/2713664657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 0x7f1a400aaa80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a4006ce90 tx=0x7f1a38009840 comp rx=0 tx=0).stop 2024-08-15T17:54:00.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0e4a6700 1 Processor -- start 2024-08-15T17:54:00.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a97fff700 1 --2- 172.21.15.33:0/65122104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 0x7f9a9815a370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c013f00 tx=0x7f9a8c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de87b02d4263aa67 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 -- 172.21.15.33:0/2713664657 shutdown_connections 2024-08-15T17:54:00.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 --2- 172.21.15.33:0/2713664657 >> v2:172.21.15.105:3300/0 conn(0x7f1a4006e620 0x7f1a400ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 --2- 172.21.15.33:0/2713664657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 0x7f1a400aaa80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 -- 172.21.15.33:0/2713664657 >> 172.21.15.33:0/2713664657 conn(0x7f1a400678d0 msgr2=0x7f1a40067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880013a0 con 0x7f9a981593b0 2024-08-15T17:54:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c009bf0 con 0x7f9a981593b0 2024-08-15T17:54:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a96ffd700 1 -- 172.21.15.33:0/65122104 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c01b400 con 0x7f9a981593b0 2024-08-15T17:54:00.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f18e1df0700 1 Processor -- start 2024-08-15T17:54:00.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 Processor -- start 2024-08-15T17:54:00.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 -- start start 2024-08-15T17:54:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 msgr2=0x7f9a9815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 --2- 172.21.15.33:0/65122104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 0x7f9a9815a370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c013f00 tx=0x7f9a8c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0e4a6700 1 -- start start 2024-08-15T17:54:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee8000700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00adf10 0x7f4ee00ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee8000700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee00cb890 con 0x7f4ee006e470 2024-08-15T17:54:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 shutdown_connections 2024-08-15T17:54:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 --2- 172.21.15.33:0/65122104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a981593b0 0x7f9a9815a370 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 >> 172.21.15.33:0/65122104 conn(0x7f9a98068300 msgr2=0x7f9a980a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f18e1df0700 1 -- start start 2024-08-15T17:54:00.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee8000700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee01610c0 con 0x7f4ee00cb450 2024-08-15T17:54:00.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee8000700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0158290 con 0x7f4ee00adf10 2024-08-15T17:54:00.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee559b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4ee006e470 0x7f4ee00cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46848/0 (socket says 172.21.15.33:46848) 2024-08-15T17:54:00.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee559b700 1 -- 172.21.15.33:0/2636983758 learned_addr learned my addr 172.21.15.33:0/2636983758 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:00.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee5d9c700 1 --2- 172.21.15.33:0/2636983758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00adf10 0x7f4ee00ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee5d9c700 1 -- 172.21.15.33:0/2636983758 >> v1:172.21.15.105:6789/0 conn(0x7f4ee00cb450 legacy=0x7f4ee00b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee5d9c700 1 -- 172.21.15.33:0/2636983758 >> v1:172.21.15.33:6789/0 conn(0x7f4ee006e470 legacy=0x7f4ee00cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee5d9c700 1 -- 172.21.15.33:0/2636983758 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00ae820 con 0x7f4ee00adf10 2024-08-15T17:54:00.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0e4a6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac0806e7d0 0x7fac08146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 Processor -- start 2024-08-15T17:54:00.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 -- start start 2024-08-15T17:54:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f4ee5d9c700 1 --2- 172.21.15.33:0/2636983758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00adf10 0x7f4ee00ae2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009910 tx=0x7f4edc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73167db0c6d3a676 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0e4a6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0815da10 con 0x7fac08146bd0 2024-08-15T17:54:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0e4a6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac081444a0 con 0x7fac0806e400 2024-08-15T17:54:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0e4a6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac08147020 con 0x7fac0806e7d0 2024-08-15T17:54:00.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 shutdown_connections 2024-08-15T17:54:00.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0ca43700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fac08146bd0 0x7fac08144930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46858/0 (socket says 172.21.15.33:46858) 2024-08-15T17:54:00.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac0ca43700 1 -- 172.21.15.33:0/3085961443 learned_addr learned my addr 172.21.15.33:0/3085961443 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac077fe700 1 --2- 172.21.15.33:0/3085961443 >> v2:172.21.15.105:3300/0 conn(0x7fac0806e7d0 0x7fac08146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c2c06e0b0 0x7f8c2c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8c2c06e480 0x7f8c2c13e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c156940 con 0x7f8c2c06aff0 2024-08-15T17:54:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c06e8d0 con 0x7f8c2c06e480 2024-08-15T17:54:00.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c311b5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c155d30 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac077fe700 1 -- 172.21.15.33:0/3085961443 >> v1:172.21.15.105:6789/0 conn(0x7fac0806e400 legacy=0x7fac080b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac077fe700 1 -- 172.21.15.33:0/3085961443 >> v1:172.21.15.33:6789/0 conn(0x7fac08146bd0 legacy=0x7fac08144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac077fe700 1 -- 172.21.15.33:0/3085961443 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08144170 con 0x7fac0806e7d0 2024-08-15T17:54:00.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c309b4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8c2c06e480 0x7f8c2c13e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c2b7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f8c2c06aff0 0x7f8c2c0b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:52330/0 (socket says 172.21.15.33:52330) 2024-08-15T17:54:00.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c2b7fe700 1 -- 172.21.15.33:0/2419869544 learned_addr learned my addr 172.21.15.33:0/2419869544 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 -- 172.21.15.33:0/2713664657 shutdown_connections 2024-08-15T17:54:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac077fe700 1 --2- 172.21.15.33:0/3085961443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac0806e7d0 0x7fac08146690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac00009e60 tx=0x7fac00009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc1947fa8f4da5d server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd28c156fb0 0x7fd28c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c0cafa0 0x7fd28c15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c15ada0 con 0x7fd28c15d4e0 2024-08-15T17:54:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c0cbce0 con 0x7fd28c156fb0 2024-08-15T17:54:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd291282700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c15d960 con 0x7fd28c0cafa0 2024-08-15T17:54:00.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/65122104 wait complete. 2024-08-15T17:54:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f1a44995700 1 -- 172.21.15.33:0/2713664657 wait complete. 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c309b4700 1 -- 172.21.15.33:0/2419869544 >> v2:172.21.15.105:3300/0 conn(0x7f8c2c06e0b0 msgr2=0x7f8c2c1556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c309b4700 1 --2- 172.21.15.33:0/2419869544 >> v2:172.21.15.105:3300/0 conn(0x7f8c2c06e0b0 0x7f8c2c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c309b4700 1 -- 172.21.15.33:0/2419869544 >> v1:172.21.15.105:6789/0 conn(0x7f8c2c06aff0 legacy=0x7f8c2c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7f8c309b4700 1 -- 172.21.15.33:0/2419869544 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c156010 con 0x7f8c2c06e480 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd28affd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd28c156fb0 0x7fd28c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd28affd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd28c156fb0 0x7fd28c0caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55798/0 (socket says 172.21.15.33:55798) 2024-08-15T17:54:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fd28affd700 1 -- 172.21.15.33:0/2140141226 learned_addr learned my addr 172.21.15.33:0/2140141226 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.111+0000 7fac06ffd700 1 -- 172.21.15.33:0/3085961443 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000e070 con 0x7fac0806e7d0 2024-08-15T17:54:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18dc06f280 0x7f18dc150780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0b11c0 con 0x7f18dc1503b0 2024-08-15T17:54:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0a9d30 con 0x7f18dc0b0490 2024-08-15T17:54:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0aee50 con 0x7f18dc06f280 2024-08-15T17:54:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28a7fc700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c0cafa0 0x7fd28c15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28affd700 1 -- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c0cafa0 msgr2=0x7fd28c15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28affd700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c0cafa0 0x7fd28c15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28affd700 1 -- 172.21.15.33:0/2140141226 >> v1:172.21.15.33:6789/0 conn(0x7fd28c15d4e0 legacy=0x7fd28c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28affd700 1 -- 172.21.15.33:0/2140141226 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c157380 con 0x7fd28c156fb0 2024-08-15T17:54:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18dc06f280 0x7f18dc150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18dc06f280 0x7f18dc150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55806/0 (socket says 172.21.15.33:55806) 2024-08-15T17:54:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 -- 172.21.15.33:0/1535091224 learned_addr learned my addr 172.21.15.33:0/1535091224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee4d9a700 1 -- 172.21.15.33:0/2636983758 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc009eb0 con 0x7f4ee00adf10 2024-08-15T17:54:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee4d9a700 1 -- 172.21.15.33:0/2636983758 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc00b760 con 0x7f4ee00adf10 2024-08-15T17:54:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee4d9a700 1 -- 172.21.15.33:0/2636983758 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00bb00 con 0x7f4ee00adf10 2024-08-15T17:54:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28a7fc700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c0cafa0 0x7fd28c15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac06ffd700 1 -- 172.21.15.33:0/3085961443 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000bc30 con 0x7fac0806e7d0 2024-08-15T17:54:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac06ffd700 1 -- 172.21.15.33:0/3085961443 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00012430 con 0x7fac0806e7d0 2024-08-15T17:54:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c309b4700 1 --2- 172.21.15.33:0/2419869544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 0x7f8c2c13e250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c064e60 tx=0x7f8c1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f430aee381b1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c2affd700 1 -- 172.21.15.33:0/2419869544 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00b740 con 0x7f8c2c06e480 2024-08-15T17:54:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 Processor -- start 2024-08-15T17:54:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 -- 172.21.15.33:0/1535091224 >> v1:172.21.15.105:6789/0 conn(0x7f18dc0b0490 legacy=0x7f18dc0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 -- 172.21.15.33:0/1535091224 >> v1:172.21.15.33:6789/0 conn(0x7f18dc1503b0 legacy=0x7f18dc06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 -- 172.21.15.33:0/1535091224 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc0af130 con 0x7f18dc06f280 2024-08-15T17:54:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 -- 172.21.15.33:0/3085961443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac0806e7d0 msgr2=0x7fac08146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/3085961443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac0806e7d0 0x7fac08146690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac00009e60 tx=0x7fac00009780 comp rx=0 tx=0).stop 2024-08-15T17:54:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 -- 172.21.15.33:0/3085961443 shutdown_connections 2024-08-15T17:54:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/3085961443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac0806e7d0 0x7fac08146690 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac00009e60 tx=0x7fac00009780 comp rx=0 tx=0).stop 2024-08-15T17:54:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 -- 172.21.15.33:0/3085961443 >> 172.21.15.33:0/3085961443 conn(0x7fac08067890 msgr2=0x7fac08067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18dbfff700 1 --2- 172.21.15.33:0/1535091224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc06f280 0x7f18dc150780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009f20 tx=0x7f18d4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f951d721f2c267b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 -- 172.21.15.33:0/2636983758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00adf10 msgr2=0x7f4ee00ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2636983758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00adf10 0x7f4ee00ae2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009910 tx=0x7f4edc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18db7fe700 1 -- 172.21.15.33:0/1535091224 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400e070 con 0x7f18dc06f280 2024-08-15T17:54:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18db7fe700 1 -- 172.21.15.33:0/1535091224 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d400ba80 con 0x7f18dc06f280 2024-08-15T17:54:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18db7fe700 1 -- 172.21.15.33:0/1535091224 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40092e0 con 0x7f18dc06f280 2024-08-15T17:54:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f1a44995700 1 Processor -- start 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 -- 172.21.15.33:0/3085961443 shutdown_connections 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 -- 172.21.15.33:0/3085961443 wait complete. 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd28affd700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c156fb0 0x7fd28c0caa60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0099e0 tx=0x7fd27c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c460d5605133b83 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd289ffb700 1 -- 172.21.15.33:0/2140141226 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00b820 con 0x7fd28c156fb0 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd289ffb700 1 -- 172.21.15.33:0/2140141226 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c00b980 con 0x7fd28c156fb0 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd289ffb700 1 -- 172.21.15.33:0/2140141226 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00bd20 con 0x7fd28c156fb0 2024-08-15T17:54:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 -- 172.21.15.33:0/2636983758 shutdown_connections 2024-08-15T17:54:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2636983758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00adf10 0x7f4ee00ae2e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 -- 172.21.15.33:0/2636983758 >> 172.21.15.33:0/2636983758 conn(0x7f4ee0067810 msgr2=0x7f4ee0067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 -- 172.21.15.33:0/2636983758 shutdown_connections 2024-08-15T17:54:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 -- 172.21.15.33:0/2636983758 wait complete. 2024-08-15T17:54:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c2affd700 1 -- 172.21.15.33:0/2419869544 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00b8a0 con 0x7f8c2c06e480 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c2affd700 1 -- 172.21.15.33:0/2419869544 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00bc40 con 0x7f8c2c06e480 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 -- 172.21.15.33:0/2419869544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 msgr2=0x7f8c2c13e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 --2- 172.21.15.33:0/2419869544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 0x7f8c2c13e250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c064e60 tx=0x7f8c1c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 -- 172.21.15.33:0/2419869544 shutdown_connections 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 --2- 172.21.15.33:0/2419869544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 0x7f8c2c13e250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 --2- 172.21.15.33:0/2419869544 >> v2:172.21.15.105:3300/0 conn(0x7f8c2c06e0b0 0x7f8c2c1556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 -- 172.21.15.33:0/2419869544 >> 172.21.15.33:0/2419869544 conn(0x7f8c2c0678d0 msgr2=0x7f8c2c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 -- 172.21.15.33:0/2419869544 shutdown_connections 2024-08-15T17:54:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 -- start start 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 0x7f9a980c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a981593b0 0x7f9a98155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9815a8b0 0x7f9a98165b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98141460 con 0x7f9a980aab50 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98155bd0 con 0x7f9a981593b0 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98166090 con 0x7f9a9815a8b0 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 0x7f9a980c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a977fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a981593b0 0x7f9a98155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 0x7f9a980c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35360/0 (socket says 172.21.15.33:35360) 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 -- 172.21.15.33:0/1672270837 learned_addr learned my addr 172.21.15.33:0/1672270837 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9ca5d700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9815a8b0 0x7f9a98165b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 -- 172.21.15.33:0/1535091224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc06f280 msgr2=0x7f18dc150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 --2- 172.21.15.33:0/1535091224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc06f280 0x7f18dc150780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009f20 tx=0x7f18d4009840 comp rx=0 tx=0).stop 2024-08-15T17:54:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f8c311b5700 1 -- 172.21.15.33:0/2419869544 wait complete. 2024-08-15T17:54:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 -- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9815a8b0 msgr2=0x7f9a98165b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9815a8b0 0x7f9a98165b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 -- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a981593b0 msgr2=0x7f9a98155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a981593b0 0x7f9a98155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 -- 172.21.15.33:0/1672270837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c013a10 con 0x7f9a980aab50 2024-08-15T17:54:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 -- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c156fb0 msgr2=0x7fd28c0caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c156fb0 0x7fd28c0caa60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0099e0 tx=0x7fd27c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 -- 172.21.15.33:0/2140141226 shutdown_connections 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c0cafa0 0x7fd28c15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 --2- 172.21.15.33:0/2140141226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c156fb0 0x7fd28c0caa60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 -- 172.21.15.33:0/2140141226 >> 172.21.15.33:0/2140141226 conn(0x7fd28c099500 msgr2=0x7fd28c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 -- 172.21.15.33:0/1535091224 shutdown_connections 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 --2- 172.21.15.33:0/1535091224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc06f280 0x7f18dc150780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f18e1df0700 1 -- 172.21.15.33:0/1535091224 >> 172.21.15.33:0/1535091224 conn(0x7f18dc066e00 msgr2=0x7f18dc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a97fff700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 0x7f9a980c8870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c015010 tx=0x7f9a8c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 -- 172.21.15.33:0/2140141226 shutdown_connections 2024-08-15T17:54:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c027750 con 0x7f9a980aab50 2024-08-15T17:54:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c0278b0 con 0x7f9a980aab50 2024-08-15T17:54:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c027c70 con 0x7f9a980aab50 2024-08-15T17:54:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fd291282700 1 -- 172.21.15.33:0/2140141226 wait complete. 2024-08-15T17:54:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 Processor -- start 2024-08-15T17:54:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7fac0e4a6700 1 -- start start 2024-08-15T17:54:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 Processor -- start 2024-08-15T17:54:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f4ee8000700 1 -- start start 2024-08-15T17:54:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 Processor -- start 2024-08-15T17:54:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 -- start start 2024-08-15T17:54:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0e4a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac0806e400 0x7fac0813dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 -- start start 2024-08-15T17:54:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0e4a6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac08146bd0 0x7fac08124ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0e4a6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 0x7fac08141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0e4a6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08125b50 con 0x7fac0806e400 2024-08-15T17:54:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0e4a6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac080c8cf0 con 0x7fac08125410 2024-08-15T17:54:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0e4a6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac080c8f40 con 0x7fac08146bd0 2024-08-15T17:54:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/1672270837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980c8e90 con 0x7f9a980aab50 2024-08-15T17:54:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.115+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/1672270837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980ca8f0 con 0x7f9a980aab50 2024-08-15T17:54:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee006e470 0x7f4ee00992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 0x7f4ee00b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00cb450 0x7f4ee00b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0096cb0 con 0x7f4ee006e470 2024-08-15T17:54:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00b13a0 con 0x7f4ee00adf10 2024-08-15T17:54:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00ab270 con 0x7f4ee00cb450 2024-08-15T17:54:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/1672270837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a780052b0 con 0x7f9a980aab50 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 Processor -- start 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 -- start start 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c06aff0 0x7f8c2c132a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c06e0b0 0x7f8c2c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 0x7f8c2c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c154020 con 0x7f8c2c06e480 2024-08-15T17:54:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c153410 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c1536f0 con 0x7f8c2c06aff0 2024-08-15T17:54:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 0x7f4ee00b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 0x7f4ee00b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55830/0 (socket says 172.21.15.33:55830) 2024-08-15T17:54:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 -- 172.21.15.33:0/2189135521 learned_addr learned my addr 172.21.15.33:0/2189135521 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee659d700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00cb450 0x7f4ee00b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee5d9c700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee006e470 0x7f4ee00992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac077fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac08146bd0 0x7fac08124ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 0x7fac08141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 0x7fac08141b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55820/0 (socket says 172.21.15.33:55820) 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 -- 172.21.15.33:0/852644172 learned_addr learned my addr 172.21.15.33:0/852644172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 -- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac08146bd0 msgr2=0x7fac08124ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac08146bd0 0x7fac08124ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 -- 172.21.15.33:0/852644172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac0806e400 msgr2=0x7fac0813dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac07fff700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac0806e400 0x7fac0813dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac0806e400 0x7fac0813dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 -- 172.21.15.33:0/852644172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00009a20 con 0x7fac08125410 2024-08-15T17:54:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c06aff0 0x7f8c2c132a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c06aff0 0x7f8c2c132a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:60062/0 (socket says 172.21.15.33:60062) 2024-08-15T17:54:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c06e0b0 0x7f8c2c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2bfff700 1 -- 172.21.15.33:0/279147757 learned_addr learned my addr 172.21.15.33:0/279147757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fac0ca43700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 0x7fac08141b00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c590 tx=0x7fabfc007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 -- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00cb450 msgr2=0x7f4ee00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00cb450 0x7f4ee00b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 -- 172.21.15.33:0/2189135521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee006e470 msgr2=0x7f4ee00992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee006e470 0x7f4ee00992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 -- 172.21.15.33:0/2189135521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc009420 con 0x7f4ee00adf10 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 -- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c06aff0 msgr2=0x7f8c2c132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c06aff0 0x7f8c2c132a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 -- 172.21.15.33:0/279147757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 msgr2=0x7f8c2c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 0x7f8c2c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 -- 172.21.15.33:0/279147757 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c009420 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 0x7fd28c0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c156fb0 0x7fd28c0c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd28c15d4e0 0x7fd28c0c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee559b700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 0x7f4ee00b0920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c810 tx=0x7f4ed0007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c5f90 con 0x7fd28c15d4e0 2024-08-15T17:54:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c5420 con 0x7fd28c0cafa0 2024-08-15T17:54:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd291282700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c56f0 con 0x7fd28c156fb0 2024-08-15T17:54:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f18e1df0700 1 -- 172.21.15.33:0/1535091224 shutdown_connections 2024-08-15T17:54:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 0x7fd28c0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f18e1df0700 1 -- 172.21.15.33:0/1535091224 wait complete. 2024-08-15T17:54:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c2b7fe700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c06e0b0 0x7f8c2c152690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400cb90 tx=0x7f8c24001970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005b30 con 0x7f4ee00adf10 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a4006e620 0x7f1a4014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 0x7f1a401506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 0x7f1a401523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40153050 con 0x7f1a40158fb0 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400c8680 con 0x7f1a4015d910 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a44995700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400c8960 con 0x7f1a4006e620 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a3ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 0x7f1a401523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a3ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 0x7f1a401523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55852/0 (socket says 172.21.15.33:55852) 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a3ffff700 1 -- 172.21.15.33:0/2955642592 learned_addr learned my addr 172.21.15.33:0/2955642592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f1a3f7fe700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a4006e620 0x7f1a4014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00ab550 con 0x7f4ee00adf10 2024-08-15T17:54:00.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee00971e0 con 0x7f4ee00adf10 2024-08-15T17:54:00.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400a850 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c1539d0 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c153110 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a3ffff700 1 -- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a4006e620 msgr2=0x7f1a4014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a3ffff700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a4006e620 0x7f1a4014ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a3ffff700 1 -- 172.21.15.33:0/2955642592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 msgr2=0x7f1a401506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a3ffff700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 0x7f1a401506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a3ffff700 1 -- 172.21.15.33:0/2955642592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38009ae0 con 0x7f1a4015d910 2024-08-15T17:54:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005c90 con 0x7f4ee00adf10 2024-08-15T17:54:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400a9b0 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400ad70 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0007320 con 0x7f4ee00adf10 2024-08-15T17:54:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a3ffff700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 0x7f1a401523f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400ea20 tx=0x7f1a340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 Processor -- start 2024-08-15T17:54:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 0x7fd28c0c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55848/0 (socket says 172.21.15.33:55848) 2024-08-15T17:54:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 -- 172.21.15.33:0/77586260 learned_addr learned my addr 172.21.15.33:0/77586260 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28a7fc700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c156fb0 0x7fd28c0c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 -- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c156fb0 msgr2=0x7fd28c0c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c156fb0 0x7fd28c0c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 -- 172.21.15.33:0/77586260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd28c15d4e0 msgr2=0x7fd28c0c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd28c15d4e0 0x7fd28c0c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.119+0000 7fd28affd700 1 -- 172.21.15.33:0/77586260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0094f0 con 0x7fd28c0cafa0 2024-08-15T17:54:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 -- start start 2024-08-15T17:54:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd28affd700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 0x7fd28c0c30e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009930 tx=0x7fd27c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c158ab0 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c011e20 con 0x7fd28c0cafa0 2024-08-15T17:54:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0c59d0 con 0x7fd28c0cafa0 2024-08-15T17:54:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40052b0 con 0x7f4ee00adf10 2024-08-15T17:54:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c14f3f0 con 0x7fd28c0cafa0 2024-08-15T17:54:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c01a630 con 0x7fd28c0cafa0 2024-08-15T17:54:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c01a7a0 con 0x7fd28c0cafa0 2024-08-15T17:54:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc06f280 0x7f18dc0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc0b0490 0x7f18dc169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 0x7f18dc0ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0969f0 con 0x7f18dc06f280 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc16a2f0 con 0x7f18dc0b0490 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e1df0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc16a5d0 con 0x7f18dc1503b0 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 0x7f18dc0ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 0x7f18dc0ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:60090/0 (socket says 172.21.15.33:60090) 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 -- 172.21.15.33:0/1379698022 learned_addr learned my addr 172.21.15.33:0/1379698022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18dbfff700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc0b0490 0x7f18dc169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9a8c01a430 con 0x7f9a980aab50 2024-08-15T17:54:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f9a7ffff700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9a840609b0 0x7f9a84062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400c7f0 con 0x7f1a4015d910 2024-08-15T17:54:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400c950 con 0x7f1a4015d910 2024-08-15T17:54:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400cd10 con 0x7f1a4015d910 2024-08-15T17:54:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8c24007300 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a8c0864b0 con 0x7f9a980aab50 2024-08-15T17:54:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f9a977fe700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9a840609b0 0x7f9a84062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 -- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc0b0490 msgr2=0x7f18dc169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc0b0490 0x7f18dc169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 -- 172.21.15.33:0/1379698022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc06f280 msgr2=0x7f18dc0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc06f280 0x7f18dc0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 -- 172.21.15.33:0/1379698022 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4009ae0 con 0x7f18dc1503b0 2024-08-15T17:54:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f18e15ef700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 0x7f18dc0ad0d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c560 tx=0x7f18d0007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a44995700 1 -- 172.21.15.33:0/2955642592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a400c8c40 con 0x7f1a4015d910 2024-08-15T17:54:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f1a44995700 1 -- 172.21.15.33:0/2955642592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a400c9280 con 0x7f1a4015d910 2024-08-15T17:54:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f9a977fe700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9a840609b0 0x7f9a84062e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a9815acc0 tx=0x7f9a88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd27c01abd0 con 0x7fd28c0cafa0 2024-08-15T17:54:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7fd272ffd700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd278060860 0x7fd278062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7fd28a7fc700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd278060860 0x7fd278062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c13fff700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8c14060af0 0x7f8c14062fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c2407d760 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4ed001b3b0 con 0x7f4ee00adf10 2024-08-15T17:54:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f4ed5ffb700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4ecc060b40 0x7f4ecc062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ed007c550 con 0x7f4ee00adf10 2024-08-15T17:54:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f4ee5d9c700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4ecc060b40 0x7f4ecc062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc005c00 con 0x7fac08125410 2024-08-15T17:54:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011590 con 0x7f18dc1503b0 2024-08-15T17:54:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc005d80 con 0x7fac08125410 2024-08-15T17:54:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc007320 con 0x7fac08125410 2024-08-15T17:54:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac080c9220 con 0x7fac08125410 2024-08-15T17:54:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.123+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac080c97e0 con 0x7fac08125410 2024-08-15T17:54:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a200052b0 con 0x7f1a4015d910 2024-08-15T17:54:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d00116f0 con 0x7f18dc1503b0 2024-08-15T17:54:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011ab0 con 0x7f18dc1503b0 2024-08-15T17:54:00.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7fd28a7fc700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd278060860 0x7fd278062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0c38e0 tx=0x7fd28400e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18e1df0700 1 -- 172.21.15.33:0/1379698022 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc16a8b0 con 0x7f18dc1503b0 2024-08-15T17:54:00.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f8c2bfff700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8c14060af0 0x7f8c14062fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18e1df0700 1 -- 172.21.15.33:0/1379698022 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc16a010 con 0x7f18dc1503b0 2024-08-15T17:54:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c0052b0 con 0x7fd28c0cafa0 2024-08-15T17:54:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe80052b0 con 0x7fac08125410 2024-08-15T17:54:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f4ee5d9c700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4ecc060b40 0x7f4ecc062ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0093f0 tx=0x7f4edc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 Processor -- start 2024-08-15T17:54:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9a8c056a10 con 0x7f9a980aab50 2024-08-15T17:54:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f8c2bfff700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8c14060af0 0x7f8c14062fa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009ca0 tx=0x7f8c20009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 -- start start 2024-08-15T17:54:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18e1df0700 1 -- 172.21.15.33:0/1379698022 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc096e40 con 0x7f18dc1503b0 2024-08-15T17:54:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f18d001b3b0 con 0x7f18dc1503b0 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff5c413e6b0 0x7ff5c40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c4155670 0x7ff5c406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c4156700 con 0x7ff5c413ea80 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c4155af0 con 0x7ff5c413e6b0 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4155dd0 con 0x7ff5c4155670 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff5c413ea80 0x7ff5c4158ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46886/0 (socket says 172.21.15.33:46886) 2024-08-15T17:54:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c37fe700 1 -- 172.21.15.33:0/1167826326 learned_addr learned my addr 172.21.15.33:0/1167826326 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c2ffd700 1 --2- 172.21.15.33:0/1167826326 >> v2:172.21.15.105:3300/0 conn(0x7ff5c413e6b0 0x7ff5c40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/1167826326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c4155670 0x7ff5c406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18d8ff9700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f18c8060930 0x7f18c8062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18d007bfd0 con 0x7f18dc1503b0 2024-08-15T17:54:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c1ffb700 1 -- 172.21.15.33:0/1167826326 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271489491 0 0) 0x7ff5c4156700 con 0x7ff5c413ea80 2024-08-15T17:54:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7ff5c1ffb700 1 -- 172.21.15.33:0/1167826326 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ac003570 con 0x7ff5c413ea80 2024-08-15T17:54:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.127+0000 7f18e0dee700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f18c8060930 0x7f18c8062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7ff5c27fc700 1 -- 172.21.15.33:0/1167826326 >> v2:172.21.15.105:3300/0 conn(0x7ff5c413e6b0 msgr2=0x7ff5c40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:00.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/1167826326 >> v2:172.21.15.105:3300/0 conn(0x7ff5c413e6b0 0x7ff5c40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7ff5c27fc700 1 -- 172.21.15.33:0/1167826326 >> v1:172.21.15.33:6789/0 conn(0x7ff5c413ea80 legacy=0x7ff5c4158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7ff5c27fc700 1 -- 172.21.15.33:0/1167826326 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c41560b0 con 0x7ff5c4155670 2024-08-15T17:54:00.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/1167826326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c4155670 0x7ff5c406df10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8007980 tx=0x7ff5b8005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ccb05c596a510f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7f18e0dee700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f18c8060930 0x7f18c8062de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0cb240 tx=0x7f18cc007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd27c052e50 con 0x7fd28c0cafa0 2024-08-15T17:54:00.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8c2404dc10 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a34013680 con 0x7f1a4015d910 2024-08-15T17:54:00.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7f1a277fe700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a2c060930 0x7f1a2c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.131+0000 7f1a3f7fe700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a2c060930 0x7f1a2c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fabfc01b3b0 con 0x7fac08125410 2024-08-15T17:54:00.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7fabeffff700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabf4060930 0x7fabf4062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7f1a3f7fe700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a2c060930 0x7f1a2c062de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009880 tx=0x7f1a38017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7fac07fff700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabf4060930 0x7fabf4062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7fac07fff700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabf4060930 0x7fabf4062de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabf8001760 tx=0x7fabf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7ff5c1ffb700 1 -- 172.21.15.33:0/1167826326 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8010070 con 0x7ff5c4155670 2024-08-15T17:54:00.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7ff5c1ffb700 1 -- 172.21.15.33:0/1167826326 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800b320 con 0x7ff5c4155670 2024-08-15T17:54:00.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7ff5c1ffb700 1 -- 172.21.15.33:0/1167826326 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800b9a0 con 0x7ff5c4155670 2024-08-15T17:54:00.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f18d004c400 con 0x7f18dc1503b0 2024-08-15T17:54:00.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7ff5c3fff700 1 -- 172.21.15.33:0/1167826326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c4155670 msgr2=0x7ff5c406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.135+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/1167826326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c4155670 0x7ff5c406df10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8007980 tx=0x7ff5b8005f00 comp rx=0 tx=0).stop 2024-08-15T17:54:00.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.139+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4ed004ca00 con 0x7f4ee00adf10 2024-08-15T17:54:00.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- 172.21.15.33:0/1167826326 shutdown_connections 2024-08-15T17:54:00.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/1167826326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c4155670 0x7ff5c406df10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/1167826326 >> v2:172.21.15.105:3300/0 conn(0x7ff5c413e6b0 0x7ff5c40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- 172.21.15.33:0/1167826326 >> 172.21.15.33:0/1167826326 conn(0x7ff5c40678d0 msgr2=0x7ff5c4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a34051dc0 con 0x7f1a4015d910 2024-08-15T17:54:00.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabfc050dc0 con 0x7fac08125410 2024-08-15T17:54:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- 172.21.15.33:0/1167826326 shutdown_connections 2024-08-15T17:54:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- 172.21.15.33:0/1167826326 wait complete. 2024-08-15T17:54:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd27c04ea50 con 0x7fd28c0cafa0 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 Processor -- start 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- start start 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 0x7ff5c416a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c413ea80 0x7ff5c4139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4154500 0x7ff5c40c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c416b7e0 con 0x7ff5c413e6b0 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40c0c30 con 0x7ff5c4154500 2024-08-15T17:54:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4154da0 con 0x7ff5c413ea80 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 0x7ff5c416a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 0x7ff5c416a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35424/0 (socket says 172.21.15.33:35424) 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 -- 172.21.15.33:0/3370403844 learned_addr learned my addr 172.21.15.33:0/3370403844 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c37fe700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4154500 0x7ff5c40c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c413ea80 0x7ff5c4139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 -- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c413ea80 msgr2=0x7ff5c4139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c413ea80 0x7ff5c4139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 -- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4154500 msgr2=0x7ff5c40c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4154500 0x7ff5c40c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c2ffd700 1 -- 172.21.15.33:0/3370403844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8007540 con 0x7ff5c413e6b0 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.143+0000 7ff5c37fe700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4154500 0x7ff5c40c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5c2ffd700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 0x7ff5c416a880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400ec80 tx=0x7ff5b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400c850 con 0x7ff5c413e6b0 2024-08-15T17:54:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b400c9b0 con 0x7ff5c413e6b0 2024-08-15T17:54:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c416af40 con 0x7ff5c413e6b0 2024-08-15T17:54:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a3404d9c0 con 0x7f1a4015d910 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c416b500 con 0x7ff5c413e6b0 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400cd50 con 0x7ff5c413e6b0 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff5b4013680 con 0x7ff5c413e6b0 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5aaffd700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5b0060860 0x7ff5b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5b407d1c0 con 0x7ff5c413e6b0 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.147+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5b0060860 0x7ff5b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.151+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5b0060860 0x7ff5b0062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800b490 tx=0x7ff5b8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.151+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fabfc04c9c0 con 0x7fac08125410 2024-08-15T17:54:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.155+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a40052b0 con 0x7ff5c413e6b0 2024-08-15T17:54:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.163+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff5b404d610 con 0x7ff5c413e6b0 2024-08-15T17:54:00.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.447+0000 7f9a9e4c0700 1 -- 172.21.15.33:0/1672270837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9a78005830 con 0x7f9a980aab50 2024-08-15T17:54:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.447+0000 7f9a7ffff700 1 -- 172.21.15.33:0/1672270837 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a8c05a030 con 0x7f9a980aab50 2024-08-15T17:54:00.452 INFO:teuthology.orchestra.run.smithi033.stdout:60129542150 2024-08-15T17:54:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 -- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9a840609b0 msgr2=0x7f9a84062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9a840609b0 0x7f9a84062e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a9815acc0 tx=0x7f9a88009040 comp rx=0 tx=0).stop 2024-08-15T17:54:00.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 -- 172.21.15.33:0/1672270837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 msgr2=0x7f9a980c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 0x7f9a980c8870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c015010 tx=0x7f9a8c019000 comp rx=0 tx=0).stop 2024-08-15T17:54:00.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 -- 172.21.15.33:0/1672270837 shutdown_connections 2024-08-15T17:54:00.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9a840609b0 0x7f9a84062e60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a981593b0 0x7f9a98155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9815a8b0 0x7f9a98165b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 --2- 172.21.15.33:0/1672270837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a980aab50 0x7f9a980c8870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 -- 172.21.15.33:0/1672270837 >> 172.21.15.33:0/1672270837 conn(0x7f9a98068300 msgr2=0x7f9a9806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 -- 172.21.15.33:0/1672270837 shutdown_connections 2024-08-15T17:54:00.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f9a7dffb700 1 -- 172.21.15.33:0/1672270837 wait complete. 2024-08-15T17:54:00.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8c2c158ab0 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.451+0000 7f8c13fff700 1 -- 172.21.15.33:0/279147757 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c2c158ab0 con 0x7f8c2c06e0b0 2024-08-15T17:54:00.456 INFO:teuthology.orchestra.run.smithi033.stdout:60129542151 2024-08-15T17:54:00.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8c14060af0 msgr2=0x7f8c14062fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8c14060af0 0x7f8c14062fa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009ca0 tx=0x7f8c20009250 comp rx=0 tx=0).stop 2024-08-15T17:54:00.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c06e0b0 msgr2=0x7f8c2c152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c06e0b0 0x7f8c2c152690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400cb90 tx=0x7f8c24001970 comp rx=0 tx=0).stop 2024-08-15T17:54:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 shutdown_connections 2024-08-15T17:54:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8c14060af0 0x7f8c14062fa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c06e0b0 0x7f8c2c152690 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c2c06e480 0x7f8c2c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 --2- 172.21.15.33:0/279147757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c06aff0 0x7f8c2c132a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 >> 172.21.15.33:0/279147757 conn(0x7f8c2c0678d0 msgr2=0x7f8c2c1583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 shutdown_connections 2024-08-15T17:54:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.459+0000 7f8c311b5700 1 -- 172.21.15.33:0/279147757 wait complete. 2024-08-15T17:54:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.463+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ec4005830 con 0x7f4ee00adf10 2024-08-15T17:54:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.463+0000 7f4ed5ffb700 1 -- 172.21.15.33:0/2189135521 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ed0050020 con 0x7f4ee00adf10 2024-08-15T17:54:00.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f18e1df0700 1 -- 172.21.15.33:0/1379698022 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f18dc16a710 con 0x7f18dc1503b0 2024-08-15T17:54:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f18d8ff9700 1 -- 172.21.15.33:0/1379698022 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18dc16a710 con 0x7f18dc1503b0 2024-08-15T17:54:00.470 INFO:teuthology.orchestra.run.smithi033.stdout:64424509447 2024-08-15T17:54:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a20005830 con 0x7f1a4015d910 2024-08-15T17:54:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a277fe700 1 -- 172.21.15.33:0/2955642592 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a34021090 con 0x7f1a4015d910 2024-08-15T17:54:00.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a2c060930 msgr2=0x7f1a2c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.472 INFO:teuthology.orchestra.run.smithi033.stdout:64424509448 2024-08-15T17:54:00.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-08-15T17:54:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a2c060930 0x7f1a2c062de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009880 tx=0x7f1a38017000 comp rx=0 tx=0).stop 2024-08-15T17:54:00.474 INFO:teuthology.orchestra.run.smithi033.stdout:60129542151 2024-08-15T17:54:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 msgr2=0x7f1a401523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 0x7f1a401523f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400ea20 tx=0x7f1a340091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4ecc060b40 msgr2=0x7f4ecc062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4ecc060b40 0x7f4ecc062ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0093f0 tx=0x7f4edc017000 comp rx=0 tx=0).stop 2024-08-15T17:54:00.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 shutdown_connections 2024-08-15T17:54:00.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 msgr2=0x7f4ee00b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 0x7f4ee00b0920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c810 tx=0x7f4ed0007ee0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a2c060930 0x7f1a2c062de0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a4015d910 0x7f1a401523f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a40158fb0 0x7f1a401506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 --2- 172.21.15.33:0/2955642592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a4006e620 0x7f1a4014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 >> 172.21.15.33:0/2955642592 conn(0x7f1a400678d0 msgr2=0x7f1a400aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 shutdown_connections 2024-08-15T17:54:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4ecc060b40 0x7f4ecc062ff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee00adf10 0x7f4ee00b0920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee00cb450 0x7f4ee00b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 --2- 172.21.15.33:0/2189135521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee006e470 0x7f4ee00992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.467+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 >> 172.21.15.33:0/2189135521 conn(0x7f4ee0067810 msgr2=0x7f4ee015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.471+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 shutdown_connections 2024-08-15T17:54:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.471+0000 7f4ee8000700 1 -- 172.21.15.33:0/2189135521 wait complete. 2024-08-15T17:54:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.471+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 shutdown_connections 2024-08-15T17:54:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.471+0000 7f1a257fa700 1 -- 172.21.15.33:0/2955642592 wait complete. 2024-08-15T17:54:00.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.471+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd26c005560 con 0x7fd28c0cafa0 2024-08-15T17:54:00.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2024-08-15T17:54:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd272ffd700 1 -- 172.21.15.33:0/77586260 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd27c052070 con 0x7fd28c0cafa0 2024-08-15T17:54:00.486 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:54:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 -- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f18c8060930 msgr2=0x7f18c8062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f18c8060930 0x7f18c8062de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0cb240 tx=0x7f18cc007b40 comp rx=0 tx=0).stop 2024-08-15T17:54:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 -- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 msgr2=0x7f18dc0ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 0x7f18dc0ad0d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c560 tx=0x7f18d0007eb0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 -- 172.21.15.33:0/1379698022 shutdown_connections 2024-08-15T17:54:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f18c8060930 0x7f18c8062de0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18dc0b0490 0x7f18dc169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18dc1503b0 0x7f18dc0ad0d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 --2- 172.21.15.33:0/1379698022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc06f280 0x7f18dc0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 -- 172.21.15.33:0/1379698022 >> 172.21.15.33:0/1379698022 conn(0x7f18dc066e00 msgr2=0x7f18dc154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 -- 172.21.15.33:0/1379698022 shutdown_connections 2024-08-15T17:54:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7f18c27fc700 1 -- 172.21.15.33:0/1379698022 wait complete. 2024-08-15T17:54:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd278060860 msgr2=0x7fd278062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd278060860 0x7fd278062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0c38e0 tx=0x7fd28400e040 comp rx=0 tx=0).stop 2024-08-15T17:54:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 msgr2=0x7fd28c0c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 0x7fd28c0c30e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009930 tx=0x7fd27c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 shutdown_connections 2024-08-15T17:54:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd278060860 0x7fd278062d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd28c15d4e0 0x7fd28c0c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd28c156fb0 0x7fd28c0c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 --2- 172.21.15.33:0/77586260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd28c0cafa0 0x7fd28c0c30e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 >> 172.21.15.33:0/77586260 conn(0x7fd28c099500 msgr2=0x7fd28c15c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 shutdown_connections 2024-08-15T17:54:00.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.475+0000 7fd291282700 1 -- 172.21.15.33:0/77586260 wait complete. 2024-08-15T17:54:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.479+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabe8005830 con 0x7fac08125410 2024-08-15T17:54:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.479+0000 7fabeffff700 1 -- 172.21.15.33:0/852644172 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabfc017070 con 0x7fac08125410 2024-08-15T17:54:00.495 INFO:teuthology.orchestra.run.smithi033.stdout:64424509448 2024-08-15T17:54:00.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabf4060930 msgr2=0x7fabf4062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabf4060930 0x7fabf4062de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabf8001760 tx=0x7fabf8009040 comp rx=0 tx=0).stop 2024-08-15T17:54:00.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 msgr2=0x7fac08141b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 0x7fac08141b00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c590 tx=0x7fabfc007ef0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 shutdown_connections 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fabf4060930 0x7fabf4062de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08125410 0x7fac08141b00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac08146bd0 0x7fac08124ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 --2- 172.21.15.33:0/852644172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac0806e400 0x7fac0813dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 >> 172.21.15.33:0/852644172 conn(0x7fac08067890 msgr2=0x7fac0815de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 shutdown_connections 2024-08-15T17:54:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7fac0e4a6700 1 -- 172.21.15.33:0/852644172 wait complete. 2024-08-15T17:54:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff5a4005830 con 0x7ff5c413e6b0 2024-08-15T17:54:00.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-08-15T17:54:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.483+0000 7ff5aaffd700 1 -- 172.21.15.33:0/3370403844 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5b4021020 con 0x7ff5c413e6b0 2024-08-15T17:54:00.501 INFO:teuthology.orchestra.run.smithi033.stdout:60129542151 2024-08-15T17:54:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5b0060860 msgr2=0x7ff5b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5b0060860 0x7ff5b0062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800b490 tx=0x7ff5b8016000 comp rx=0 tx=0).stop 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 msgr2=0x7ff5c416a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 0x7ff5c416a880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400ec80 tx=0x7ff5b40091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 shutdown_connections 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5b0060860 0x7ff5b0062d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4154500 0x7ff5c40c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c413ea80 0x7ff5c4139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 --2- 172.21.15.33:0/3370403844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c413e6b0 0x7ff5c416a880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 >> 172.21.15.33:0/3370403844 conn(0x7ff5c40678d0 msgr2=0x7ff5c40caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 shutdown_connections 2024-08-15T17:54:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:00.487+0000 7ff5c3fff700 1 -- 172.21.15.33:0/3370403844 wait complete. 2024-08-15T17:54:00.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2024-08-15T17:54:00.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2024-08-15T17:54:00.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-08-15T17:54:00.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2024-08-15T17:54:01.474 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-15T17:54:01.486 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-15T17:54:01.499 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-15T17:54:01.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-15T17:54:01.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-15T17:54:01.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-15T17:54:01.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-15T17:54:01.506 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-15T17:54:01.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.607+0000 7f34ff8b2700 1 Processor -- start 2024-08-15T17:54:01.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.607+0000 7f34ff8b2700 1 -- start start 2024-08-15T17:54:01.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.607+0000 7f34ff8b2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34f813ba00 0x7f34f8160150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.607+0000 7f34ff8b2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f813cf90 con 0x7f34f813b630 2024-08-15T17:54:01.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.607+0000 7f34ff8b2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80b1b20 con 0x7f34f813bf10 2024-08-15T17:54:01.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.607+0000 7f34ff8b2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f813c380 con 0x7f34f813ba00 2024-08-15T17:54:01.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34f813ba00 0x7f34f8160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34f813ba00 0x7f34f8160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35438/0 (socket says 172.21.15.33:35438) 2024-08-15T17:54:01.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 -- 172.21.15.33:0/1487294114 learned_addr learned my addr 172.21.15.33:0/1487294114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 -- 172.21.15.33:0/1487294114 >> v1:172.21.15.105:6789/0 conn(0x7f34f813bf10 legacy=0x7f34f806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 -- 172.21.15.33:0/1487294114 >> v1:172.21.15.33:6789/0 conn(0x7f34f813b630 legacy=0x7f34f80b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 -- 172.21.15.33:0/1487294114 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f813c660 con 0x7f34f813ba00 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34effff700 1 -- 172.21.15.33:0/1487294114 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731806799 0 0) 0x7f34f813cf90 con 0x7f34f813b630 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34fde4f700 1 --2- 172.21.15.33:0/1487294114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8160150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f34f000cac0 tx=0x7f34f000c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c983433e6b6747c server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34effff700 1 -- 172.21.15.33:0/1487294114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f000bb90 con 0x7f34f813ba00 2024-08-15T17:54:01.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34effff700 1 -- 172.21.15.33:0/1487294114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f000bcf0 con 0x7f34f813ba00 2024-08-15T17:54:01.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34effff700 1 -- 172.21.15.33:0/1487294114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f000c0b0 con 0x7f34f813ba00 2024-08-15T17:54:01.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1487294114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 msgr2=0x7f34f8160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 --2- 172.21.15.33:0/1487294114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8160150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f34f000cac0 tx=0x7f34f000c3c0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1487294114 shutdown_connections 2024-08-15T17:54:01.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 --2- 172.21.15.33:0/1487294114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8160150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1487294114 >> 172.21.15.33:0/1487294114 conn(0x7f34f80678d0 msgr2=0x7f34f8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1487294114 shutdown_connections 2024-08-15T17:54:01.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.611+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1487294114 wait complete. 2024-08-15T17:54:01.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 Processor -- start 2024-08-15T17:54:01.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 -- start start 2024-08-15T17:54:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34f813b630 0x7f34f81684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34f813bf10 0x7f34f8168be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c16c0 con 0x7f34f813ba00 2024-08-15T17:54:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80ca2a0 con 0x7f34f813b630 2024-08-15T17:54:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34ff8b2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c9690 con 0x7f34f813bf10 2024-08-15T17:54:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fd64e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34f813b630 0x7f34f81684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8167310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35452/0 (socket says 172.21.15.33:35452) 2024-08-15T17:54:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 -- 172.21.15.33:0/1495799320 learned_addr learned my addr 172.21.15.33:0/1495799320 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fde4f700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34f813bf10 0x7f34f8168be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 -- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34f813bf10 msgr2=0x7f34f8168be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34f813bf10 0x7f34f8168be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 -- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34f813b630 msgr2=0x7f34f81684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34f813b630 0x7f34f81684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.615+0000 7f34fce4d700 1 -- 172.21.15.33:0/1495799320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f000c600 con 0x7f34f813ba00 2024-08-15T17:54:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.619+0000 7f34fce4d700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8167310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34e800b5e0 tx=0x7f34e8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.619+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800f510 con 0x7f34f813ba00 2024-08-15T17:54:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.619+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1495799320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f80c9970 con 0x7f34f813ba00 2024-08-15T17:54:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.619+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1495799320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f80c9f30 con 0x7f34f813ba00 2024-08-15T17:54:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e800f670 con 0x7f34f813ba00 2024-08-15T17:54:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800fa30 con 0x7f34f813ba00 2024-08-15T17:54:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f34e801a400 con 0x7f34f813ba00 2024-08-15T17:54:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34ed7fa700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f34e4060b20 0x7f34e4062fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34e807c650 con 0x7f34f813ba00 2024-08-15T17:54:01.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34fd64e700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f34e4060b20 0x7f34e4062fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1495799320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d80052b0 con 0x7f34f813ba00 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc747fff700 1 Processor -- start 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc747fff700 1 -- start start 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc747fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc748155670 0x7fc74806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc747fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc748156700 con 0x7fc74813e6b0 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc747fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc748155af0 con 0x7fc74813ea80 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc747fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc748155dd0 con 0x7fc748155670 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc7467fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc748155670 0x7fc74806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc7467fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc748155670 0x7fc74806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35456/0 (socket says 172.21.15.33:35456) 2024-08-15T17:54:01.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.623+0000 7fc7467fc700 1 -- 172.21.15.33:0/3090857972 learned_addr learned my addr 172.21.15.33:0/3090857972 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.627+0000 7fc7467fc700 1 -- 172.21.15.33:0/3090857972 >> v1:172.21.15.105:6789/0 conn(0x7fc74813ea80 legacy=0x7fc748156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.627+0000 7fc7467fc700 1 -- 172.21.15.33:0/3090857972 >> v1:172.21.15.33:6789/0 conn(0x7fc74813e6b0 legacy=0x7fc7480b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.627+0000 7fc7467fc700 1 -- 172.21.15.33:0/3090857972 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7481560b0 con 0x7fc748155670 2024-08-15T17:54:01.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.627+0000 7fc7467fc700 1 --2- 172.21.15.33:0/3090857972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc748155670 0x7fc74806df10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc7380090e0 tx=0x7fc738009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef555d825d8a96db server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.627+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f34e804cb00 con 0x7f34f813ba00 2024-08-15T17:54:01.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.631+0000 7fc745ffb700 1 -- 172.21.15.33:0/3090857972 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800b7c0 con 0x7fc748155670 2024-08-15T17:54:01.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.631+0000 7fc745ffb700 1 -- 172.21.15.33:0/3090857972 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800b920 con 0x7fc748155670 2024-08-15T17:54:01.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.631+0000 7f34fd64e700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f34e4060b20 0x7f34e4062fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34f4007fd0 tx=0x7f34f4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 -- 172.21.15.33:0/3090857972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc748155670 msgr2=0x7fc74806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 --2- 172.21.15.33:0/3090857972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc748155670 0x7fc74806df10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc7380090e0 tx=0x7fc738009ae0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 -- 172.21.15.33:0/3090857972 shutdown_connections 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 --2- 172.21.15.33:0/3090857972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc748155670 0x7fc74806df10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 -- 172.21.15.33:0/3090857972 >> 172.21.15.33:0/3090857972 conn(0x7fc7480678d0 msgr2=0x7fc748067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 -- 172.21.15.33:0/3090857972 shutdown_connections 2024-08-15T17:54:01.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 -- 172.21.15.33:0/3090857972 wait complete. 2024-08-15T17:54:01.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fbe467d2700 1 Processor -- start 2024-08-15T17:54:01.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 Processor -- start 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fbe467d2700 1 -- start start 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe40155670 0x7fbe4006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbe4013ea80 0x7fbe4006e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe40156700 con 0x7fbe4013e6b0 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe40155af0 con 0x7fbe4013ea80 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40155dd0 con 0x7fbe40155670 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe457d0700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbe4013e6b0 0x7fbe400b1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46920/0 (socket says 172.21.15.33:46920) 2024-08-15T17:54:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe457d0700 1 -- 172.21.15.33:0/3374595278 learned_addr learned my addr 172.21.15.33:0/3374595278 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:01.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.635+0000 7fc747fff700 1 -- start start 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74813e6b0 0x7fc748154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc74813ea80 0x7fc7480c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 0x7fc7480c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74816f780 con 0x7fc74813ea80 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480c69f0 con 0x7fc7480c6590 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74816ee90 con 0x7fc74813e6b0 2024-08-15T17:54:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe45fd1700 1 --2- 172.21.15.33:0/3374595278 >> v2:172.21.15.105:3300/0 conn(0x7fbe4013ea80 0x7fbe4006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7477fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 0x7fc7480c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc74813ea80 0x7fc7480c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7477fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 0x7fc7480c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55914/0 (socket says 172.21.15.33:55914) 2024-08-15T17:54:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7477fe700 1 -- 172.21.15.33:0/507007514 learned_addr learned my addr 172.21.15.33:0/507007514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc746ffd700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74813e6b0 0x7fc748154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe44fcf700 1 --2- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe40155670 0x7fbe4006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe45fd1700 1 -- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe40155670 msgr2=0x7fbe4006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe45fd1700 1 --2- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe40155670 0x7fbe4006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe37fff700 1 -- 172.21.15.33:0/3374595278 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747972974 0 0) 0x7fbe40156700 con 0x7fbe4013e6b0 2024-08-15T17:54:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe45fd1700 1 -- 172.21.15.33:0/3374595278 >> v1:172.21.15.33:6789/0 conn(0x7fbe4013e6b0 legacy=0x7fbe400b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe45fd1700 1 -- 172.21.15.33:0/3374595278 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe401560b0 con 0x7fbe4013ea80 2024-08-15T17:54:01.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 -- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74813e6b0 msgr2=0x7fc748154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74813e6b0 0x7fc748154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 -- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 msgr2=0x7fc7480c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 0x7fc7480c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 -- 172.21.15.33:0/507007514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009d80 con 0x7fc74813ea80 2024-08-15T17:54:01.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7477fe700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 0x7fc7480c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:01.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe45fd1700 1 --2- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4013ea80 0x7fbe4006e450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe300098e0 tx=0x7fbe300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e24d818113f39f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc7467fc700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc74813ea80 0x7fc7480c6050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc738014000 tx=0x7fc738018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe37fff700 1 -- 172.21.15.33:0/3374595278 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30013a90 con 0x7fbe4013ea80 2024-08-15T17:54:01.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe37fff700 1 -- 172.21.15.33:0/3374595278 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30013bf0 con 0x7fbe4013ea80 2024-08-15T17:54:01.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe37fff700 1 -- 172.21.15.33:0/3374595278 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000c440 con 0x7fbe4013ea80 2024-08-15T17:54:01.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73801c040 con 0x7fc74813ea80 2024-08-15T17:54:01.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800be40 con 0x7fc74813ea80 2024-08-15T17:54:01.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738022640 con 0x7fc74813ea80 2024-08-15T17:54:01.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7480c2280 con 0x7fc74813ea80 2024-08-15T17:54:01.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74816f410 con 0x7fc74813ea80 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 -- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4013ea80 msgr2=0x7fbe4006e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.639+0000 7fbe467d2700 1 --2- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4013ea80 0x7fbe4006e450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe300098e0 tx=0x7fbe300091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/3374595278 shutdown_connections 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 --2- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4013ea80 0x7fbe4006e450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 --2- 172.21.15.33:0/3374595278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe40155670 0x7fbe4006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/3374595278 >> 172.21.15.33:0/3374595278 conn(0x7fbe400678d0 msgr2=0x7fbe40067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/3374595278 shutdown_connections 2024-08-15T17:54:01.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/3374595278 wait complete. 2024-08-15T17:54:01.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74816f930 con 0x7fc74813ea80 2024-08-15T17:54:01.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc738022a30 con 0x7fc74813ea80 2024-08-15T17:54:01.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fc72effd700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc7340609b0 0x7fc734062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc73807eb30 con 0x7fc74813ea80 2024-08-15T17:54:01.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fc746ffd700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc7340609b0 0x7fc734062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.651+0000 7fc746ffd700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc7340609b0 0x7fc734062e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc748171220 tx=0x7fc73c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 Processor -- start 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- start start 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 0x7fbe40154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe457d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 0x7fbe40154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe457d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 0x7fbe40154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35472/0 (socket says 172.21.15.33:35472) 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe457d0700 1 -- 172.21.15.33:0/523478898 learned_addr learned my addr 172.21.15.33:0/523478898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4013ea80 0x7fbe400c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe400c19a0 0x7fbe401385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe401530d0 con 0x7fbe4013e6b0 2024-08-15T17:54:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe401533b0 con 0x7fbe400c19a0 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.643+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40153690 con 0x7fbe4013ea80 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe44fcf700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4013ea80 0x7fbe400c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe457d0700 1 -- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4013ea80 msgr2=0x7fbe400c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe457d0700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4013ea80 0x7fbe400c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe457d0700 1 -- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe400c19a0 msgr2=0x7fbe401385c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe457d0700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe400c19a0 0x7fbe401385c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe457d0700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009420 con 0x7fbe4013e6b0 2024-08-15T17:54:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.647+0000 7fbe457d0700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 0x7fbe40154170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbe38001be0 tx=0x7fbe38006480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.651+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380082e0 con 0x7fbe4013e6b0 2024-08-15T17:54:01.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.651+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc74816f930 con 0x7fc74813ea80 2024-08-15T17:54:01.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.651+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe40153970 con 0x7fbe4013e6b0 2024-08-15T17:54:01.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.651+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3801e660 con 0x7fbe4013e6b0 2024-08-15T17:54:01.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe400ae240 con 0x7fbe4013e6b0 2024-08-15T17:54:01.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3801ea20 con 0x7fbe4013e6b0 2024-08-15T17:54:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe40153e40 con 0x7fbe4013e6b0 2024-08-15T17:54:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe38006510 con 0x7fbe4013e6b0 2024-08-15T17:54:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe357fa700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe240608e0 0x7fbe24062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe3809e710 con 0x7fbe4013e6b0 2024-08-15T17:54:01.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.655+0000 7fbe44fcf700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe240608e0 0x7fbe24062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.659+0000 7fbe44fcf700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe240608e0 0x7fbe24062d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe400ae070 tx=0x7fbe3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.663+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe3806eac0 con 0x7fbe4013e6b0 2024-08-15T17:54:01.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f078137a700 1 Processor -- start 2024-08-15T17:54:01.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f078137a700 1 -- start start 2024-08-15T17:54:01.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f078137a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f077c0aae80 0x7f077c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f078137a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c06e3c0 con 0x7f077c0ab250 2024-08-15T17:54:01.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f078137a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c06d7b0 con 0x7f077c06e850 2024-08-15T17:54:01.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f078137a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c06da90 con 0x7f077c0aae80 2024-08-15T17:54:01.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f077b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f077c0ab250 0x7f077c161d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46930/0 (socket says 172.21.15.33:46930) 2024-08-15T17:54:01.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f077b7fe700 1 -- 172.21.15.33:0/4254506218 learned_addr learned my addr 172.21.15.33:0/4254506218 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:01.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f077bfff700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f077c0aae80 0x7f077c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740674240 0 0) 0x7f077c06e3c0 con 0x7f077c0ab250 2024-08-15T17:54:01.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0764003570 con 0x7f077c0ab250 2024-08-15T17:54:01.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.675+0000 7fd9f2342700 1 Processor -- start 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624914178 0 0) 0x7f077c06d7b0 con 0x7f077c06e850 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f077c06e3c0 con 0x7f077c06e850 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1459120675 0 0) 0x7f0764003570 con 0x7f077c0ab250 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f077c0aae80 msgr2=0x7f077c06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f077c0aae80 0x7f077c06d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 >> v1:172.21.15.105:6789/0 conn(0x7f077c06e850 legacy=0x7f077c15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c06dd70 con 0x7f077c0ab250 2024-08-15T17:54:01.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f07740017f0 con 0x7f077c0ab250 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 >> v1:172.21.15.33:6789/0 conn(0x7f077c0ab250 legacy=0x7f077c161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0764003c20 0x7f0764004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0764004810 0x7f0764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07640051c0 0x7f076400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c06da90 con 0x7f0764003c20 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076400c0b0 con 0x7f0764004810 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076400c270 con 0x7f07640051c0 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077bfff700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f077c0aae80 0x7f077c06d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077bfff700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0764003c20 0x7f0764004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0764004810 0x7f0764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f0780b79700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07640051c0 0x7f076400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f2342700 1 -- start start 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 -- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07640051c0 msgr2=0x7f076400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07640051c0 0x7f076400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 -- 172.21.15.33:0/4254506218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0764003c20 msgr2=0x7f0764004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0764003c20 0x7f0764004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 -- 172.21.15.33:0/4254506218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764003570 con 0x7f0764004810 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077bfff700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0764003c20 0x7f0764004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077b7fe700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0764004810 0x7f0764004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f077400a800 tx=0x7f07740020c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b874a80f03bb0bbb server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740071a0 con 0x7f0764004810 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774007300 con 0x7f0764004810 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f077affd700 1 -- 172.21.15.33:0/4254506218 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740076c0 con 0x7f0764004810 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f078137a700 1 -- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0764004810 msgr2=0x7f0764004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f078137a700 1 --2- 172.21.15.33:0/4254506218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0764004810 0x7f0764004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f077400a800 tx=0x7f07740020c0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f0780b79700 1 -- 172.21.15.33:0/4254506218 reap_dead start 2024-08-15T17:54:01.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f2342700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec0ae120 0x7fd9ec06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f2342700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9ec06e520 0x7fd9ec0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f2342700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec06e970 con 0x7fd9ec0a9260 2024-08-15T17:54:01.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f2342700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ec0a96c0 con 0x7fd9ec06e520 2024-08-15T17:54:01.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f2342700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0af620 con 0x7fd9ec0ae120 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1b41700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd9ec0a9260 0x7fd9ec158f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46936/0 (socket says 172.21.15.33:46936) 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1b41700 1 -- 172.21.15.33:0/292280903 learned_addr learned my addr 172.21.15.33:0/292280903 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1340700 1 --2- 172.21.15.33:0/292280903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec0ae120 0x7fd9ec06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9e3fff700 1 -- 172.21.15.33:0/292280903 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682195173 0 0) 0x7fd9ec06e970 con 0x7fd9ec0a9260 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9e3fff700 1 -- 172.21.15.33:0/292280903 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d8003570 con 0x7fd9ec0a9260 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f078137a700 1 -- 172.21.15.33:0/4254506218 shutdown_connections 2024-08-15T17:54:01.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f078137a700 1 -- 172.21.15.33:0/4254506218 >> 172.21.15.33:0/4254506218 conn(0x7f077c066e00 msgr2=0x7f077c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f0b3f700 1 --2- 172.21.15.33:0/292280903 >> v2:172.21.15.33:3300/0 conn(0x7fd9ec06e520 0x7fd9ec0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f078137a700 1 -- 172.21.15.33:0/4254506218 shutdown_connections 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1340700 1 -- 172.21.15.33:0/292280903 >> v2:172.21.15.33:3300/0 conn(0x7fd9ec06e520 msgr2=0x7fd9ec0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1340700 1 --2- 172.21.15.33:0/292280903 >> v2:172.21.15.33:3300/0 conn(0x7fd9ec06e520 0x7fd9ec0a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1340700 1 -- 172.21.15.33:0/292280903 >> v1:172.21.15.33:6789/0 conn(0x7fd9ec0a9260 legacy=0x7fd9ec158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1340700 1 -- 172.21.15.33:0/292280903 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec06eba0 con 0x7fd9ec0ae120 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f0b3f700 1 --2- 172.21.15.33:0/292280903 >> v2:172.21.15.33:3300/0 conn(0x7fd9ec06e520 0x7fd9ec0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7fd9f1340700 1 --2- 172.21.15.33:0/292280903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec0ae120 0x7fd9ec06dfe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80090e0 tx=0x7fd9e8009a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9033c7b22e5792b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9e3fff700 1 -- 172.21.15.33:0/292280903 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800b690 con 0x7fd9ec0ae120 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9e3fff700 1 -- 172.21.15.33:0/292280903 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e800b7f0 con 0x7fd9ec0ae120 2024-08-15T17:54:01.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9e3fff700 1 -- 172.21.15.33:0/292280903 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800bb70 con 0x7fd9ec0ae120 2024-08-15T17:54:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.679+0000 7f078137a700 1 -- 172.21.15.33:0/4254506218 wait complete. 2024-08-15T17:54:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 Processor -- start 2024-08-15T17:54:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 -- start start 2024-08-15T17:54:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 -- 172.21.15.33:0/292280903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec0ae120 msgr2=0x7fd9ec06dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 --2- 172.21.15.33:0/292280903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec0ae120 0x7fd9ec06dfe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80090e0 tx=0x7fd9e8009a30 comp rx=0 tx=0).stop 2024-08-15T17:54:01.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0764004810 0x7f077c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f077c179910 0x7f077c0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 0x7f077c097dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0969f0 con 0x7f077c0ad8c0 2024-08-15T17:54:01.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c17a140 con 0x7f077c179910 2024-08-15T17:54:01.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f078137a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c17a420 con 0x7f0764004810 2024-08-15T17:54:01.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 -- 172.21.15.33:0/292280903 shutdown_connections 2024-08-15T17:54:01.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 --2- 172.21.15.33:0/292280903 >> v2:172.21.15.33:3300/0 conn(0x7fd9ec06e520 0x7fd9ec0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 --2- 172.21.15.33:0/292280903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec0ae120 0x7fd9ec06dfe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 -- 172.21.15.33:0/292280903 >> 172.21.15.33:0/292280903 conn(0x7fd9ec066e00 msgr2=0x7fd9ec067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 -- 172.21.15.33:0/292280903 shutdown_connections 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 0x7f077c097dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 0x7f077c097dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35498/0 (socket says 172.21.15.33:35498) 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 -- 172.21.15.33:0/2933132624 learned_addr learned my addr 172.21.15.33:0/2933132624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f077bfff700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0764004810 0x7f077c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f077b7fe700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f077c179910 0x7f077c0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 -- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0764004810 msgr2=0x7f077c0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0764004810 0x7f077c0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 -- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f077c179910 msgr2=0x7f077c0ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f077c179910 0x7f077c0ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 -- 172.21.15.33:0/2933132624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c17a700 con 0x7f077c0ad8c0 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7f0780b79700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 0x7f077c097dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f077c06f300 tx=0x7f0770007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 -- 172.21.15.33:0/292280903 wait complete. 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 Processor -- start 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.683+0000 7fd9f2342700 1 -- start start 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 0x7fd9ec0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9ec0a9260 0x7fd9ec13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9ec0ae120 0x7fd9ec0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec13ef80 con 0x7fd9ec0ae120 2024-08-15T17:54:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec156e30 con 0x7fd9ec0a9260 2024-08-15T17:54:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0cb440 con 0x7fd9ec06e520 2024-08-15T17:54:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770006a30 con 0x7f077c0ad8c0 2024-08-15T17:54:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770006b90 con 0x7f077c0ad8c0 2024-08-15T17:54:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c096c40 con 0x7f077c0ad8c0 2024-08-15T17:54:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c098310 con 0x7f077c0ad8c0 2024-08-15T17:54:01.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 0x7fd9ec0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 0x7fd9ec0c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:60172/0 (socket says 172.21.15.33:60172) 2024-08-15T17:54:01.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 -- 172.21.15.33:0/224935262 learned_addr learned my addr 172.21.15.33:0/224935262 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f0b3f700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9ec0a9260 0x7fd9ec13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1b41700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9ec0ae120 0x7fd9ec0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770007030 con 0x7f077c0ad8c0 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f07700073e0 con 0x7f077c0ad8c0 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 -- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9ec0a9260 msgr2=0x7fd9ec13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9ec0a9260 0x7fd9ec13ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 -- 172.21.15.33:0/224935262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9ec0ae120 msgr2=0x7fd9ec0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9ec0ae120 0x7fd9ec0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 -- 172.21.15.33:0/224935262 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e8009cb0 con 0x7fd9ec06e520 2024-08-15T17:54:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1b41700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9ec0ae120 0x7fd9ec0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:01.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f1340700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 0x7fd9ec0c8bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0af760 tx=0x7fd9e8018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f0763fff700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f07640626e0 0x7f0764064b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f077007c580 con 0x7f077c0ad8c0 2024-08-15T17:54:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800b960 con 0x7fd9ec06e520 2024-08-15T17:54:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec0cb6c0 con 0x7fd9ec06e520 2024-08-15T17:54:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec156ac0 con 0x7fd9ec06e520 2024-08-15T17:54:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f077bfff700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f07640626e0 0x7f0764064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7f077bfff700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f07640626e0 0x7f0764064b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f076c006d60 tx=0x7f076c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e800bae0 con 0x7fd9ec06e520 2024-08-15T17:54:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8023650 con 0x7fd9ec06e520 2024-08-15T17:54:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.687+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec156920 con 0x7fd9ec06e520 2024-08-15T17:54:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.691+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd9e80103f0 con 0x7fd9ec06e520 2024-08-15T17:54:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.691+0000 7fd9e17fa700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd9d8060cc0 0x7fd9d8063170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.691+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9e807e4b0 con 0x7fd9ec06e520 2024-08-15T17:54:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.691+0000 7fd9f0b3f700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd9d8060cc0 0x7fd9d8063170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.691+0000 7fd9f0b3f700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd9d8060cc0 0x7fd9d8063170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0b06e0 tx=0x7fd9dc006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 Processor -- start 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 -- start start 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6013f670 0x7fdf6006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf600b02a0 0x7fdf600ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6015a420 con 0x7fdf6013fa40 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf60159af0 con 0x7fdf600b02a0 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60159dd0 con 0x7fdf6013f670 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf600b02a0 0x7fdf600ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf600b02a0 0x7fdf600ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35516/0 (socket says 172.21.15.33:35516) 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 -- 172.21.15.33:0/1277554481 learned_addr learned my addr 172.21.15.33:0/1277554481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5e59c700 1 --2- 172.21.15.33:0/1277554481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6013f670 0x7fdf6006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 -- 172.21.15.33:0/1277554481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6013f670 msgr2=0x7fdf6006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 --2- 172.21.15.33:0/1277554481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6013f670 0x7fdf6006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 -- 172.21.15.33:0/1277554481 >> v1:172.21.15.105:6789/0 conn(0x7fdf6013fa40 legacy=0x7fdf600afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 -- 172.21.15.33:0/1277554481 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6015a0b0 con 0x7fdf600b02a0 2024-08-15T17:54:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5ed9d700 1 --2- 172.21.15.33:0/1277554481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf600b02a0 0x7fdf600ac7f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800d1a0 tx=0x7fdf5800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89996470c4bef2b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c0052b0 con 0x7f077c0ad8c0 2024-08-15T17:54:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5d59a700 1 -- 172.21.15.33:0/1277554481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58010070 con 0x7fdf600b02a0 2024-08-15T17:54:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5d59a700 1 -- 172.21.15.33:0/1277554481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5800b0d0 con 0x7fdf600b02a0 2024-08-15T17:54:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf5d59a700 1 -- 172.21.15.33:0/1277554481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800b490 con 0x7fdf600b02a0 2024-08-15T17:54:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7f0975ab9700 1 Processor -- start 2024-08-15T17:54:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7f0975ab9700 1 -- start start 2024-08-15T17:54:01.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 -- 172.21.15.33:0/1277554481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf600b02a0 msgr2=0x7fdf600ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.695+0000 7fdf64c24700 1 --2- 172.21.15.33:0/1277554481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf600b02a0 0x7fdf600ac7f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800d1a0 tx=0x7fdf5800ba50 comp rx=0 tx=0).stop 2024-08-15T17:54:01.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 -- 172.21.15.33:0/1277554481 shutdown_connections 2024-08-15T17:54:01.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 --2- 172.21.15.33:0/1277554481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf600b02a0 0x7fdf600ac7f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 --2- 172.21.15.33:0/1277554481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6013f670 0x7fdf6006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 -- 172.21.15.33:0/1277554481 >> 172.21.15.33:0/1277554481 conn(0x7fdf600678d0 msgr2=0x7fdf60067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 -- 172.21.15.33:0/1277554481 shutdown_connections 2024-08-15T17:54:01.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 -- 172.21.15.33:0/1277554481 wait complete. 2024-08-15T17:54:01.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 Processor -- start 2024-08-15T17:54:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f097015d910 0x7f097006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097006e8b0 con 0x7f097006e450 2024-08-15T17:54:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09700ab2d0 con 0x7f0970158fb0 2024-08-15T17:54:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700ab5b0 con 0x7f097015d910 2024-08-15T17:54:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f09752b8700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f097006e450 0x7f09700ac370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46948/0 (socket says 172.21.15.33:46948) 2024-08-15T17:54:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f09752b8700 1 -- 172.21.15.33:0/2685140175 learned_addr learned my addr 172.21.15.33:0/2685140175 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096ffff700 1 --2- 172.21.15.33:0/2685140175 >> v2:172.21.15.105:3300/0 conn(0x7f097015d910 0x7f097006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096f7fe700 1 -- 172.21.15.33:0/2685140175 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660712566 0 0) 0x7f09700ab2d0 con 0x7f0970158fb0 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096f7fe700 1 -- 172.21.15.33:0/2685140175 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0958003570 con 0x7f0970158fb0 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096ffff700 1 -- 172.21.15.33:0/2685140175 >> v1:172.21.15.105:6789/0 conn(0x7f0970158fb0 legacy=0x7f09700aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096ffff700 1 -- 172.21.15.33:0/2685140175 >> v1:172.21.15.33:6789/0 conn(0x7f097006e450 legacy=0x7f09700ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096ffff700 1 -- 172.21.15.33:0/2685140175 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700ab890 con 0x7f097015d910 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096ffff700 1 --2- 172.21.15.33:0/2685140175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097015d910 0x7f097006df10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0964011fc0 tx=0x7f0964011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9e956bf04d98bb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096f7fe700 1 -- 172.21.15.33:0/2685140175 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964027070 con 0x7f097015d910 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096f7fe700 1 -- 172.21.15.33:0/2685140175 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964013bd0 con 0x7f097015d910 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f096f7fe700 1 -- 172.21.15.33:0/2685140175 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964011020 con 0x7f097015d910 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- 172.21.15.33:0/2685140175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097015d910 msgr2=0x7f097006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 --2- 172.21.15.33:0/2685140175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097015d910 0x7f097006df10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0964011fc0 tx=0x7f0964011a30 comp rx=0 tx=0).stop 2024-08-15T17:54:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- 172.21.15.33:0/2685140175 shutdown_connections 2024-08-15T17:54:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 --2- 172.21.15.33:0/2685140175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097015d910 0x7f097006df10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- 172.21.15.33:0/2685140175 >> 172.21.15.33:0/2685140175 conn(0x7f09700678d0 msgr2=0x7f0970067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- 172.21.15.33:0/2685140175 shutdown_connections 2024-08-15T17:54:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7f0975ab9700 1 -- 172.21.15.33:0/2685140175 wait complete. 2024-08-15T17:54:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fdf64c24700 1 -- start start 2024-08-15T17:54:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.699+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd9e804e980 con 0x7fd9ec06e520 2024-08-15T17:54:01.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 Processor -- start 2024-08-15T17:54:01.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 -- start start 2024-08-15T17:54:01.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097006e450 0x7f097014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 0x7f0970155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097015d910 0x7f0970157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09701536d0 con 0x7f0970158fb0 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09701544f0 con 0x7f097006e450 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0975ab9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097014d1a0 con 0x7f097015d910 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 0x7f0970155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 0x7f0970155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35526/0 (socket says 172.21.15.33:35526) 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 -- 172.21.15.33:0/3775371525 learned_addr learned my addr 172.21.15.33:0/3775371525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0974ab7700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097006e450 0x7f097014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f09752b8700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097015d910 0x7f0970157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 -- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097015d910 msgr2=0x7f0970157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097015d910 0x7f0970157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 -- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097006e450 msgr2=0x7f097014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097006e450 0x7f097014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 -- 172.21.15.33:0/3775371525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0964011cd0 con 0x7f0970158fb0 2024-08-15T17:54:01.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f077004ca90 con 0x7f077c0ad8c0 2024-08-15T17:54:01.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.703+0000 7f096ffff700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 0x7f0970155020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0964011ca0 tx=0x7f0964027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 Processor -- start 2024-08-15T17:54:01.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 -- start start 2024-08-15T17:54:01.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400fb30 con 0x7f0970158fb0 2024-08-15T17:54:01.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096400fc90 con 0x7f0970158fb0 2024-08-15T17:54:01.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09701538e0 con 0x7f0970158fb0 2024-08-15T17:54:01.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096402d630 con 0x7f0970158fb0 2024-08-15T17:54:01.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f91ec0b13b0 0x7f91ec0b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 0x7f91ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec069f30 con 0x7f91ec0adb90 2024-08-15T17:54:01.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec0b1e50 con 0x7f91ec0b13b0 2024-08-15T17:54:01.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f33c6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec069600 con 0x7f91ec06a3c0 2024-08-15T17:54:01.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0970153ea0 con 0x7f0970158fb0 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 0x7f91ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 0x7f91ec06a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:60208/0 (socket says 172.21.15.33:60208) 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 -- 172.21.15.33:0/3507936613 learned_addr learned my addr 172.21.15.33:0/3507936613 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 -- 172.21.15.33:0/3507936613 >> v2:172.21.15.105:3300/0 conn(0x7f91ec0b13b0 msgr2=0x7f91ec0b17f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 --2- 172.21.15.33:0/3507936613 >> v2:172.21.15.105:3300/0 conn(0x7f91ec0b13b0 0x7f91ec0b17f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 -- 172.21.15.33:0/3507936613 >> v1:172.21.15.33:6789/0 conn(0x7f91ec0adb90 legacy=0x7f91ec0adf60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 -- 172.21.15.33:0/3507936613 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0698e0 con 0x7f91ec06a3c0 2024-08-15T17:54:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91f1963700 1 --2- 172.21.15.33:0/3507936613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 0x7f91ec06a840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009f20 tx=0x7f91e4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bba39bc0f60a4e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf64c24700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf600b02a0 0x7fdf601358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf64c24700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf6013f670 0x7fdf600ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf64c24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf6013fa40 0x7fdf600ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf64c24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60156fb0 con 0x7fdf6013fa40 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf64c24700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60157290 con 0x7fdf6013f670 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf64c24700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60157570 con 0x7fdf600b02a0 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf6013fa40 0x7fdf600ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf6013fa40 0x7fdf600ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35530/0 (socket says 172.21.15.33:35530) 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf6013f670 0x7fdf600ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5ed9d700 1 -- 172.21.15.33:0/2205822863 learned_addr learned my addr 172.21.15.33:0/2205822863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 -- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf600b02a0 msgr2=0x7fdf601358a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf600b02a0 0x7fdf601358a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 -- 172.21.15.33:0/2205822863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf6013fa40 msgr2=0x7fdf600ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf6013fa40 0x7fdf600ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 -- 172.21.15.33:0/2205822863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5800bcf0 con 0x7fdf6013f670 2024-08-15T17:54:01.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf5dd9b700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf6013f670 0x7fdf600ca770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c490 tx=0x7fdf54007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91e3fff700 1 -- 172.21.15.33:0/3507936613 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400e070 con 0x7f91ec06a3c0 2024-08-15T17:54:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91e3fff700 1 -- 172.21.15.33:0/3507936613 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e400bb10 con 0x7f91ec06a3c0 2024-08-15T17:54:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7f91e3fff700 1 -- 172.21.15.33:0/3507936613 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40092e0 con 0x7f91ec06a3c0 2024-08-15T17:54:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f096400e070 con 0x7f0970158fb0 2024-08-15T17:54:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 -- 172.21.15.33:0/3507936613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 msgr2=0x7f91ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 --2- 172.21.15.33:0/3507936613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 0x7f91ec06a840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009f20 tx=0x7f91e4009840 comp rx=0 tx=0).stop 2024-08-15T17:54:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.711+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54011590 con 0x7fdf6013f670 2024-08-15T17:54:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf60157850 con 0x7fdf6013f670 2024-08-15T17:54:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf60135de0 con 0x7fdf6013f670 2024-08-15T17:54:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf540116f0 con 0x7fdf6013f670 2024-08-15T17:54:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54011ab0 con 0x7fdf6013f670 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 -- 172.21.15.33:0/3507936613 shutdown_connections 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 --2- 172.21.15.33:0/3507936613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec06a3c0 0x7f91ec06a840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 --2- 172.21.15.33:0/3507936613 >> v2:172.21.15.105:3300/0 conn(0x7f91ec0b13b0 0x7f91ec0b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 -- 172.21.15.33:0/3507936613 >> 172.21.15.33:0/3507936613 conn(0x7f91ec068320 msgr2=0x7f91ec0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 -- 172.21.15.33:0/3507936613 shutdown_connections 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 -- 172.21.15.33:0/3507936613 wait complete. 2024-08-15T17:54:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09500052b0 con 0x7f0970158fb0 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f096cff9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f095c0609b0 0x7f095c062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f096408f4c0 con 0x7f0970158fb0 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f0974ab7700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f095c0609b0 0x7f095c062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f0974ab7700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f095c0609b0 0x7f095c062e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0970063b00 tx=0x7f0960007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440052b0 con 0x7fdf6013f670 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdf5401b3b0 con 0x7fdf6013f670 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7fdf4e7fc700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf400609b0 0x7fdf40062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf5407be70 con 0x7fdf6013f670 2024-08-15T17:54:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7fdf5e59c700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf400609b0 0x7fdf40062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 Processor -- start 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.715+0000 7f91f33c6700 1 -- start start 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f33c6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91ec06a3c0 0x7f91ec0ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f33c6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec0adb90 0x7f91ec157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f33c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 0x7f91ec0aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f33c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec1536f0 con 0x7f91ec0b13b0 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f33c6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec152f00 con 0x7f91ec06a3c0 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f33c6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec1578d0 con 0x7f91ec0adb90 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 0x7f91ec0aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 0x7f91ec0aa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35538/0 (socket says 172.21.15.33:35538) 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 -- 172.21.15.33:0/797873394 learned_addr learned my addr 172.21.15.33:0/797873394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1162700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91ec06a3c0 0x7f91ec0ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f0961700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec0adb90 0x7f91ec157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 -- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec0adb90 msgr2=0x7f91ec157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec0adb90 0x7f91ec157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 -- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91ec06a3c0 msgr2=0x7f91ec0ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91ec06a3c0 0x7f91ec0ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 -- 172.21.15.33:0/797873394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4009ae0 con 0x7f91ec0b13b0 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7f91f1963700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 0x7f91ec0aa7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f91ec069740 tx=0x7f91e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.719+0000 7fdf5e59c700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf400609b0 0x7fdf40062e60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009a60 tx=0x7fdf50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.723+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4008dd0 con 0x7f91ec0b13b0 2024-08-15T17:54:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.723+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f096405f8f0 con 0x7f0970158fb0 2024-08-15T17:54:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.723+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e401c410 con 0x7f91ec0b13b0 2024-08-15T17:54:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.723+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec0ac8d0 con 0x7f91ec0b13b0 2024-08-15T17:54:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.723+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec157560 con 0x7f91ec0b13b0 2024-08-15T17:54:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.727+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4009940 con 0x7f91ec0b13b0 2024-08-15T17:54:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.727+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec157a40 con 0x7f91ec0b13b0 2024-08-15T17:54:01.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.727+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f91e4003040 con 0x7f91ec0b13b0 2024-08-15T17:54:01.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.727+0000 7f91e17fa700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f91d0060860 0x7f91d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:01.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.727+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91e407e340 con 0x7f91ec0b13b0 2024-08-15T17:54:01.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.731+0000 7f91f1162700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f91d0060860 0x7f91d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:01.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.731+0000 7f91f1162700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f91d0060860 0x7f91d0062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91dc003aa0 tx=0x7f91dc000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:01.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.735+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdf5404c2a0 con 0x7fdf6013f670 2024-08-15T17:54:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.739+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f91e404e790 con 0x7f91ec0b13b0 2024-08-15T17:54:01.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.955+0000 7f34ff8b2700 1 -- 172.21.15.33:0/1495799320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f34d8005560 con 0x7f34f813ba00 2024-08-15T17:54:01.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.955+0000 7f34ed7fa700 1 -- 172.21.15.33:0/1495799320 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34e8050120 con 0x7f34f813ba00 2024-08-15T17:54:01.958 INFO:teuthology.orchestra.run.smithi033.stdout:60129542151 2024-08-15T17:54:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.955+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc74816f930 con 0x7fc74813ea80 2024-08-15T17:54:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.955+0000 7f34e2ffd700 1 -- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f34e4060b20 msgr2=0x7f34e4062fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.955+0000 7fc72effd700 1 -- 172.21.15.33:0/507007514 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc74816f930 con 0x7fc74813ea80 2024-08-15T17:54:01.959 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:54:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.955+0000 7f34e2ffd700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f34e4060b20 0x7f34e4062fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34f4007fd0 tx=0x7f34f4007d30 comp rx=0 tx=0).stop 2024-08-15T17:54:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 -- 172.21.15.33:0/1495799320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 msgr2=0x7f34f8167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8167310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34e800b5e0 tx=0x7f34e8009120 comp rx=0 tx=0).stop 2024-08-15T17:54:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 -- 172.21.15.33:0/1495799320 shutdown_connections 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f34e4060b20 0x7f34e4062fd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34f813bf10 0x7f34f8168be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f813ba00 0x7f34f8167310 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 --2- 172.21.15.33:0/1495799320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34f813b630 0x7f34f81684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 -- 172.21.15.33:0/1495799320 >> 172.21.15.33:0/1495799320 conn(0x7f34f80678d0 msgr2=0x7f34f806e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc7340609b0 msgr2=0x7fc734062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 -- 172.21.15.33:0/1495799320 shutdown_connections 2024-08-15T17:54:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc7340609b0 0x7fc734062e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc748171220 tx=0x7fc73c009040 comp rx=0 tx=0).stop 2024-08-15T17:54:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7f34e2ffd700 1 -- 172.21.15.33:0/1495799320 wait complete. 2024-08-15T17:54:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc74813ea80 msgr2=0x7fc7480c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc74813ea80 0x7fc7480c6050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc738014000 tx=0x7fc738018000 comp rx=0 tx=0).stop 2024-08-15T17:54:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 shutdown_connections 2024-08-15T17:54:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc7340609b0 0x7fc734062e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7480c6590 0x7fc7480c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc74813ea80 0x7fc7480c6050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 --2- 172.21.15.33:0/507007514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74813e6b0 0x7fc748154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 >> 172.21.15.33:0/507007514 conn(0x7fc7480678d0 msgr2=0x7fc7480aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 shutdown_connections 2024-08-15T17:54:01.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.959+0000 7fc747fff700 1 -- 172.21.15.33:0/507007514 wait complete. 2024-08-15T17:54:01.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-08-15T17:54:01.977 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:01.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-08-15T17:54:01.978 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:01.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.975+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe400643a0 con 0x7fbe4013e6b0 2024-08-15T17:54:01.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe357fa700 1 -- 172.21.15.33:0/523478898 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe38015020 con 0x7fbe4013e6b0 2024-08-15T17:54:01.979 INFO:teuthology.orchestra.run.smithi033.stdout:64424509449 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe240608e0 msgr2=0x7fbe24062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe240608e0 0x7fbe24062d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe400ae070 tx=0x7fbe3c008040 comp rx=0 tx=0).stop 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 msgr2=0x7fbe40154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 0x7fbe40154170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbe38001be0 tx=0x7fbe38006480 comp rx=0 tx=0).stop 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 shutdown_connections 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe240608e0 0x7fbe24062d90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe400c19a0 0x7fbe401385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4013ea80 0x7fbe400c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 --2- 172.21.15.33:0/523478898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe4013e6b0 0x7fbe40154170 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:01.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 >> 172.21.15.33:0/523478898 conn(0x7fbe400678d0 msgr2=0x7fbe40157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:01.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 shutdown_connections 2024-08-15T17:54:01.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.979+0000 7fbe467d2700 1 -- 172.21.15.33:0/523478898 wait complete. 2024-08-15T17:54:01.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-08-15T17:54:01.991 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f075c005830 con 0x7f077c0ad8c0 2024-08-15T17:54:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f0763fff700 1 -- 172.21.15.33:0/2933132624 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07700500b0 con 0x7f077c0ad8c0 2024-08-15T17:54:02.000 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f07640626e0 msgr2=0x7f0764064b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f07640626e0 0x7f0764064b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f076c006d60 tx=0x7f076c008040 comp rx=0 tx=0).stop 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 msgr2=0x7f077c097dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 0x7f077c097dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f077c06f300 tx=0x7f0770007d30 comp rx=0 tx=0).stop 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 shutdown_connections 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f07640626e0 0x7f0764064b90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f077c179910 0x7f077c0ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f077c0ad8c0 0x7f077c097dd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 --2- 172.21.15.33:0/2933132624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0764004810 0x7f077c0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 >> 172.21.15.33:0/2933132624 conn(0x7f077c066e00 msgr2=0x7f077c15fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 shutdown_connections 2024-08-15T17:54:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:01.999+0000 7f078137a700 1 -- 172.21.15.33:0/2933132624 wait complete. 2024-08-15T17:54:02.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-08-15T17:54:02.014 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:02.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.015+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9ec156920 con 0x7fd9ec06e520 2024-08-15T17:54:02.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.015+0000 7fd9e17fa700 1 -- 172.21.15.33:0/224935262 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9ec156920 con 0x7fd9ec06e520 2024-08-15T17:54:02.017 INFO:teuthology.orchestra.run.smithi033.stdout:60129542152 2024-08-15T17:54:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd9d8060cc0 msgr2=0x7fd9d8063170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd9d8060cc0 0x7fd9d8063170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0b06e0 tx=0x7fd9dc006f90 comp rx=0 tx=0).stop 2024-08-15T17:54:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 msgr2=0x7fd9ec0c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 0x7fd9ec0c8bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0af760 tx=0x7fd9e8018000 comp rx=0 tx=0).stop 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 shutdown_connections 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd9d8060cc0 0x7fd9d8063170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9ec0a9260 0x7fd9ec13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9ec0ae120 0x7fd9ec0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 --2- 172.21.15.33:0/224935262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9ec06e520 0x7fd9ec0c8bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 >> 172.21.15.33:0/224935262 conn(0x7fd9ec066e00 msgr2=0x7fd9ec098a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 shutdown_connections 2024-08-15T17:54:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.019+0000 7fd9f2342700 1 -- 172.21.15.33:0/224935262 wait complete. 2024-08-15T17:54:02.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2024-08-15T17:54:02.033 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:02.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.043+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f91ec0644b0 con 0x7f91ec0b13b0 2024-08-15T17:54:02.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.043+0000 7f91e17fa700 1 -- 172.21.15.33:0/797873394 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91e4008f30 con 0x7f91ec0b13b0 2024-08-15T17:54:02.045 INFO:teuthology.orchestra.run.smithi033.stdout:64424509448 2024-08-15T17:54:02.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.043+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0950005560 con 0x7f0970158fb0 2024-08-15T17:54:02.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.043+0000 7f096cff9700 1 -- 172.21.15.33:0/3775371525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0964062f10 con 0x7f0970158fb0 2024-08-15T17:54:02.046 INFO:teuthology.orchestra.run.smithi033.stdout:64424509449 2024-08-15T17:54:02.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f91d0060860 msgr2=0x7f91d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f91d0060860 0x7f91d0062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91dc003aa0 tx=0x7f91dc000bc0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 msgr2=0x7f91ec0aa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 0x7f91ec0aa7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f91ec069740 tx=0x7f91e4018000 comp rx=0 tx=0).stop 2024-08-15T17:54:02.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 shutdown_connections 2024-08-15T17:54:02.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f91d0060860 0x7f91d0062d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91ec0b13b0 0x7f91ec0aa7a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91ec0adb90 0x7f91ec157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 --2- 172.21.15.33:0/797873394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91ec06a3c0 0x7f91ec0ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 >> 172.21.15.33:0/797873394 conn(0x7f91ec068320 msgr2=0x7f91ec06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 shutdown_connections 2024-08-15T17:54:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f91f33c6700 1 -- 172.21.15.33:0/797873394 wait complete. 2024-08-15T17:54:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f095c0609b0 msgr2=0x7f095c062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f095c0609b0 0x7f095c062e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0970063b00 tx=0x7f0960007d30 comp rx=0 tx=0).stop 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 msgr2=0x7f0970155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 0x7f0970155020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0964011ca0 tx=0x7f0964027000 comp rx=0 tx=0).stop 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 shutdown_connections 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f095c0609b0 0x7f095c062e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097015d910 0x7f0970157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970158fb0 0x7f0970155020 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 --2- 172.21.15.33:0/3775371525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097006e450 0x7f097014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 >> 172.21.15.33:0/3775371525 conn(0x7f09700678d0 msgr2=0x7f0970069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 shutdown_connections 2024-08-15T17:54:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.047+0000 7f0975ab9700 1 -- 172.21.15.33:0/3775371525 wait complete. 2024-08-15T17:54:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.051+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdf44005560 con 0x7fdf6013f670 2024-08-15T17:54:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.051+0000 7fdf4e7fc700 1 -- 172.21.15.33:0/2205822863 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf54017090 con 0x7fdf6013f670 2024-08-15T17:54:02.051 INFO:teuthology.orchestra.run.smithi033.stdout:60129542153 2024-08-15T17:54:02.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf400609b0 msgr2=0x7fdf40062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf400609b0 0x7fdf40062e60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009a60 tx=0x7fdf50008040 comp rx=0 tx=0).stop 2024-08-15T17:54:02.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf6013f670 msgr2=0x7fdf600ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf6013f670 0x7fdf600ca770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c490 tx=0x7fdf54007ea0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 shutdown_connections 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdf400609b0 0x7fdf40062e60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf6013f670 0x7fdf600ca770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf6013fa40 0x7fdf600ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 --2- 172.21.15.33:0/2205822863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf600b02a0 0x7fdf601358a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 >> 172.21.15.33:0/2205822863 conn(0x7fdf600678d0 msgr2=0x7fdf6013e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 shutdown_connections 2024-08-15T17:54:02.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.055+0000 7fdf64c24700 1 -- 172.21.15.33:0/2205822863 wait complete. 2024-08-15T17:54:02.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-08-15T17:54:02.059 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:02.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-08-15T17:54:02.066 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:02.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2024-08-15T17:54:02.067 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:02.067 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-15T17:54:02.067 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:54:02.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 Processor -- start 2024-08-15T17:54:02.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 -- start start 2024-08-15T17:54:02.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0a24158eb0 0x7f0a240aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a240aecc0 0x7f0a2406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240ac000 con 0x7f0a24159280 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a240ad4a0 con 0x7f0a24158eb0 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a29b5e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a240ab3f0 con 0x7f0a240aecc0 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a28b5c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0a24158eb0 0x7f0a240aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a2935d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0a24159280 0x7f0a240a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46966/0 (socket says 172.21.15.33:46966) 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a2935d700 1 -- 172.21.15.33:0/1539425414 learned_addr learned my addr 172.21.15.33:0/1539425414 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.163+0000 7f0a23fff700 1 --2- 172.21.15.33:0/1539425414 >> v2:172.21.15.105:3300/0 conn(0x7f0a240aecc0 0x7f0a2406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a28b5c700 1 -- 172.21.15.33:0/1539425414 >> v2:172.21.15.105:3300/0 conn(0x7f0a240aecc0 msgr2=0x7f0a2406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a28b5c700 1 --2- 172.21.15.33:0/1539425414 >> v2:172.21.15.105:3300/0 conn(0x7f0a240aecc0 0x7f0a2406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a28b5c700 1 -- 172.21.15.33:0/1539425414 >> v1:172.21.15.33:6789/0 conn(0x7f0a24159280 legacy=0x7f0a240a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a237fe700 1 -- 172.21.15.33:0/1539425414 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812803387 0 0) 0x7f0a240ac000 con 0x7f0a24159280 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a28b5c700 1 -- 172.21.15.33:0/1539425414 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240ab6d0 con 0x7f0a24158eb0 2024-08-15T17:54:02.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a28b5c700 1 --2- 172.21.15.33:0/1539425414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a240aaa80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a240aeb30 tx=0x7f0a140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f566c2a4857f62 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a237fe700 1 -- 172.21.15.33:0/1539425414 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14011630 con 0x7f0a24158eb0 2024-08-15T17:54:02.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a237fe700 1 -- 172.21.15.33:0/1539425414 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14011790 con 0x7f0a24158eb0 2024-08-15T17:54:02.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a237fe700 1 -- 172.21.15.33:0/1539425414 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14011b30 con 0x7f0a24158eb0 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 -- 172.21.15.33:0/1539425414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 msgr2=0x7f0a240aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/1539425414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a240aaa80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a240aeb30 tx=0x7f0a140091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 -- 172.21.15.33:0/1539425414 shutdown_connections 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/1539425414 >> v2:172.21.15.105:3300/0 conn(0x7f0a240aecc0 0x7f0a2406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/1539425414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a240aaa80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 -- 172.21.15.33:0/1539425414 >> 172.21.15.33:0/1539425414 conn(0x7f0a240678d0 msgr2=0x7f0a24067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 -- 172.21.15.33:0/1539425414 shutdown_connections 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 -- 172.21.15.33:0/1539425414 wait complete. 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 Processor -- start 2024-08-15T17:54:02.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.167+0000 7f0a29b5e700 1 -- start start 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a240aecc0 0x7f0a24155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a2415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a24159280 0x7f0a2415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415b860 con 0x7f0a24158eb0 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415bb40 con 0x7f0a240aecc0 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415be20 con 0x7f0a24159280 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a2415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a2415aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35550/0 (socket says 172.21.15.33:35550) 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 -- 172.21.15.33:0/3450174253 learned_addr learned my addr 172.21.15.33:0/3450174253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a2935d700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a24159280 0x7f0a2415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a28b5c700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a240aecc0 0x7f0a24155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 -- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a24159280 msgr2=0x7f0a2415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a24159280 0x7f0a2415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 -- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a240aecc0 msgr2=0x7f0a24155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a240aecc0 0x7f0a24155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 -- 172.21.15.33:0/3450174253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14009420 con 0x7f0a24158eb0 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a28b5c700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a240aecc0 0x7f0a24155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a23fff700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a2415aea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00ec80 tx=0x7f0a0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00c850 con 0x7f0a24158eb0 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00c9b0 con 0x7f0a24158eb0 2024-08-15T17:54:02.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2415c100 con 0x7f0a24158eb0 2024-08-15T17:54:02.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00cd50 con 0x7f0a24158eb0 2024-08-15T17:54:02.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2415b3e0 con 0x7f0a24158eb0 2024-08-15T17:54:02.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.171+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a240643a0 con 0x7f0a24158eb0 2024-08-15T17:54:02.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.175+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0a0c013680 con 0x7f0a24158eb0 2024-08-15T17:54:02.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.175+0000 7f0a20ff9700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a08060860 0x7f0a08062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.175+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a0c07cf30 con 0x7f0a24158eb0 2024-08-15T17:54:02.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.175+0000 7f0a28b5c700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a08060860 0x7f0a08062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.175+0000 7f0a28b5c700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a08060860 0x7f0a08062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a140093f0 tx=0x7f0a14017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.179+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0a0c04d2e0 con 0x7f0a24158eb0 2024-08-15T17:54:02.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.335+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a2406f5f0 con 0x7f0a08060860 2024-08-15T17:54:02.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.351+0000 7f0a20ff9700 1 -- 172.21.15.33:0/3450174253 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264363 (secure 0 0 0) 0x7f0a2406f5f0 con 0x7f0a08060860 2024-08-15T17:54:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:02.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a08060860 msgr2=0x7f0a08062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a08060860 0x7f0a08062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a140093f0 tx=0x7f0a14017000 comp rx=0 tx=0).stop 2024-08-15T17:54:02.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 msgr2=0x7f0a2415aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a2415aea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00ec80 tx=0x7f0a0c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 shutdown_connections 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0a08060860 0x7f0a08062d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a24159280 0x7f0a2415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a24158eb0 0x7f0a2415aea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 --2- 172.21.15.33:0/3450174253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a240aecc0 0x7f0a24155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 >> 172.21.15.33:0/3450174253 conn(0x7f0a240678d0 msgr2=0x7f0a24152400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 shutdown_connections 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.359+0000 7f0a29b5e700 1 -- 172.21.15.33:0/3450174253 wait complete. 2024-08-15T17:54:02.363 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:54:02.375 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-08-15T17:54:02.241424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385896,"kb_used_data":2856,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588824,"statfs":{"total":773094113280,"available":770650955776,"internally_reserved":0,"allocated":2924544,"data_stored":1768412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1574,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.353033"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915754+0000","last_change":"2024-08-15T17:53:50.914055+0000","last_active":"2024-08-15T17:53:50.915754+0000","last_peered":"2024-08-15T17:53:50.915754+0000","last_clean":"2024-08-15T17:53:50.915754+0000","last_became_active":"2024-08-15T17:53:50.912515+0000","last_became_peered":"2024-08-15T17:53:50.912515+0000","last_unstale":"2024-08-15T17:53:50.915754+0000","last_undegraded":"2024-08-15T17:53:50.915754+0000","last_fullsized":"2024-08-15T17:53:50.915754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916931+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.916931+0000","last_peered":"2024-08-15T17:53:50.916931+0000","last_clean":"2024-08-15T17:53:50.916931+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.916931+0000","last_undegraded":"2024-08-15T17:53:50.916931+0000","last_fullsized":"2024-08-15T17:53:50.916931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.919237+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.919237+0000","last_peered":"2024-08-15T17:53:50.919237+0000","last_clean":"2024-08-15T17:53:50.919237+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.919237+0000","last_undegraded":"2024-08-15T17:53:50.919237+0000","last_fullsized":"2024-08-15T17:53:50.919237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921467+0000","last_change":"2024-08-15T17:53:50.914898+0000","last_active":"2024-08-15T17:53:50.921467+0000","last_peered":"2024-08-15T17:53:50.921467+0000","last_clean":"2024-08-15T17:53:50.921467+0000","last_became_active":"2024-08-15T17:53:50.914603+0000","last_became_peered":"2024-08-15T17:53:50.914603+0000","last_unstale":"2024-08-15T17:53:50.921467+0000","last_undegraded":"2024-08-15T17:53:50.921467+0000","last_fullsized":"2024-08-15T17:53:50.921467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:11.104066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913847+0000","last_change":"2024-08-15T17:53:50.904384+0000","last_active":"2024-08-15T17:53:50.913847+0000","last_peered":"2024-08-15T17:53:50.913847+0000","last_clean":"2024-08-15T17:53:50.913847+0000","last_became_active":"2024-08-15T17:53:50.904058+0000","last_became_peered":"2024-08-15T17:53:50.904058+0000","last_unstale":"2024-08-15T17:53:50.913847+0000","last_undegraded":"2024-08-15T17:53:50.913847+0000","last_fullsized":"2024-08-15T17:53:50.913847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921547+0000","last_change":"2024-08-15T17:53:50.914850+0000","last_active":"2024-08-15T17:53:50.921547+0000","last_peered":"2024-08-15T17:53:50.921547+0000","last_clean":"2024-08-15T17:53:50.921547+0000","last_became_active":"2024-08-15T17:53:50.914627+0000","last_became_peered":"2024-08-15T17:53:50.914627+0000","last_unstale":"2024-08-15T17:53:50.921547+0000","last_undegraded":"2024-08-15T17:53:50.921547+0000","last_fullsized":"2024-08-15T17:53:50.921547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913990+0000","last_change":"2024-08-15T17:53:50.906406+0000","last_active":"2024-08-15T17:53:50.913990+0000","last_peered":"2024-08-15T17:53:50.913990+0000","last_clean":"2024-08-15T17:53:50.913990+0000","last_became_active":"2024-08-15T17:53:50.906100+0000","last_became_peered":"2024-08-15T17:53:50.906100+0000","last_unstale":"2024-08-15T17:53:50.913990+0000","last_undegraded":"2024-08-15T17:53:50.913990+0000","last_fullsized":"2024-08-15T17:53:50.913990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:13.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909252+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.909252+0000","last_peered":"2024-08-15T17:53:50.909252+0000","last_clean":"2024-08-15T17:53:50.909252+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.909252+0000","last_undegraded":"2024-08-15T17:53:50.909252+0000","last_fullsized":"2024-08-15T17:53:50.909252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.924946+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.924946+0000","last_peered":"2024-08-15T17:53:50.924946+0000","last_clean":"2024-08-15T17:53:50.924946+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.924946+0000","last_undegraded":"2024-08-15T17:53:50.924946+0000","last_fullsized":"2024-08-15T17:53:50.924946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913903+0000","last_change":"2024-08-15T17:53:50.903622+0000","last_active":"2024-08-15T17:53:50.913903+0000","last_peered":"2024-08-15T17:53:50.913903+0000","last_clean":"2024-08-15T17:53:50.913903+0000","last_became_active":"2024-08-15T17:53:50.903273+0000","last_became_peered":"2024-08-15T17:53:50.903273+0000","last_unstale":"2024-08-15T17:53:50.913903+0000","last_undegraded":"2024-08-15T17:53:50.913903+0000","last_fullsized":"2024-08-15T17:53:50.913903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915664+0000","last_change":"2024-08-15T17:53:50.913949+0000","last_active":"2024-08-15T17:53:50.915664+0000","last_peered":"2024-08-15T17:53:50.915664+0000","last_clean":"2024-08-15T17:53:50.915664+0000","last_became_active":"2024-08-15T17:53:50.912318+0000","last_became_peered":"2024-08-15T17:53:50.912318+0000","last_unstale":"2024-08-15T17:53:50.915664+0000","last_undegraded":"2024-08-15T17:53:50.915664+0000","last_fullsized":"2024-08-15T17:53:50.915664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916410+0000","last_change":"2024-08-15T17:53:50.914253+0000","last_active":"2024-08-15T17:53:50.916410+0000","last_peered":"2024-08-15T17:53:50.916410+0000","last_clean":"2024-08-15T17:53:50.916410+0000","last_became_active":"2024-08-15T17:53:50.912891+0000","last_became_peered":"2024-08-15T17:53:50.912891+0000","last_unstale":"2024-08-15T17:53:50.916410+0000","last_undegraded":"2024-08-15T17:53:50.916410+0000","last_fullsized":"2024-08-15T17:53:50.916410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:46.552157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911666+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.911666+0000","last_peered":"2024-08-15T17:53:50.911666+0000","last_clean":"2024-08-15T17:53:50.911666+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.911666+0000","last_undegraded":"2024-08-15T17:53:50.911666+0000","last_fullsized":"2024-08-15T17:53:50.911666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914568+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.914568+0000","last_peered":"2024-08-15T17:53:50.914568+0000","last_clean":"2024-08-15T17:53:50.914568+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.914568+0000","last_undegraded":"2024-08-15T17:53:50.914568+0000","last_fullsized":"2024-08-15T17:53:50.914568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910692+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.910692+0000","last_peered":"2024-08-15T17:53:50.910692+0000","last_clean":"2024-08-15T17:53:50.910692+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.910692+0000","last_undegraded":"2024-08-15T17:53:50.910692+0000","last_fullsized":"2024-08-15T17:53:50.910692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926051+0000","last_change":"2024-08-15T17:53:50.918930+0000","last_active":"2024-08-15T17:53:50.926051+0000","last_peered":"2024-08-15T17:53:50.926051+0000","last_clean":"2024-08-15T17:53:50.926051+0000","last_became_active":"2024-08-15T17:53:50.918540+0000","last_became_peered":"2024-08-15T17:53:50.918540+0000","last_unstale":"2024-08-15T17:53:50.926051+0000","last_undegraded":"2024-08-15T17:53:50.926051+0000","last_fullsized":"2024-08-15T17:53:50.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:47:00.308854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925996+0000","last_change":"2024-08-15T17:53:50.918137+0000","last_active":"2024-08-15T17:53:50.925996+0000","last_peered":"2024-08-15T17:53:50.925996+0000","last_clean":"2024-08-15T17:53:50.925996+0000","last_became_active":"2024-08-15T17:53:50.917839+0000","last_became_peered":"2024-08-15T17:53:50.917839+0000","last_unstale":"2024-08-15T17:53:50.925996+0000","last_undegraded":"2024-08-15T17:53:50.925996+0000","last_fullsized":"2024-08-15T17:53:50.925996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:47:03.604696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912296+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.912296+0000","last_peered":"2024-08-15T17:53:50.912296+0000","last_clean":"2024-08-15T17:53:50.912296+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.912296+0000","last_undegraded":"2024-08-15T17:53:50.912296+0000","last_fullsized":"2024-08-15T17:53:50.912296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922087+0000","last_change":"2024-08-15T17:53:50.915095+0000","last_active":"2024-08-15T17:53:50.922087+0000","last_peered":"2024-08-15T17:53:50.922087+0000","last_clean":"2024-08-15T17:53:50.922087+0000","last_became_active":"2024-08-15T17:53:50.914811+0000","last_became_peered":"2024-08-15T17:53:50.914811+0000","last_unstale":"2024-08-15T17:53:50.922087+0000","last_undegraded":"2024-08-15T17:53:50.922087+0000","last_fullsized":"2024-08-15T17:53:50.922087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915199+0000","last_change":"2024-08-15T17:53:50.911317+0000","last_active":"2024-08-15T17:53:50.915199+0000","last_peered":"2024-08-15T17:53:50.915199+0000","last_clean":"2024-08-15T17:53:50.915199+0000","last_became_active":"2024-08-15T17:53:50.910983+0000","last_became_peered":"2024-08-15T17:53:50.910983+0000","last_unstale":"2024-08-15T17:53:50.915199+0000","last_undegraded":"2024-08-15T17:53:50.915199+0000","last_fullsized":"2024-08-15T17:53:50.915199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:17:53.857852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914138+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.914138+0000","last_peered":"2024-08-15T17:53:50.914138+0000","last_clean":"2024-08-15T17:53:50.914138+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.914138+0000","last_undegraded":"2024-08-15T17:53:50.914138+0000","last_fullsized":"2024-08-15T17:53:50.914138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922366+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.922366+0000","last_peered":"2024-08-15T17:53:50.922366+0000","last_clean":"2024-08-15T17:53:50.922366+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.922366+0000","last_undegraded":"2024-08-15T17:53:50.922366+0000","last_fullsized":"2024-08-15T17:53:50.922366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909117+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.909117+0000","last_peered":"2024-08-15T17:53:50.909117+0000","last_clean":"2024-08-15T17:53:50.909117+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.909117+0000","last_undegraded":"2024-08-15T17:53:50.909117+0000","last_fullsized":"2024-08-15T17:53:50.909117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920128+0000","last_change":"2024-08-15T17:53:50.908561+0000","last_active":"2024-08-15T17:53:50.920128+0000","last_peered":"2024-08-15T17:53:50.920128+0000","last_clean":"2024-08-15T17:53:50.920128+0000","last_became_active":"2024-08-15T17:53:50.908263+0000","last_became_peered":"2024-08-15T17:53:50.908263+0000","last_unstale":"2024-08-15T17:53:50.920128+0000","last_undegraded":"2024-08-15T17:53:50.920128+0000","last_fullsized":"2024-08-15T17:53:50.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:07:38.806189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916877+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.916877+0000","last_peered":"2024-08-15T17:53:50.916877+0000","last_clean":"2024-08-15T17:53:50.916877+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.916877+0000","last_undegraded":"2024-08-15T17:53:50.916877+0000","last_fullsized":"2024-08-15T17:53:50.916877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925176+0000","last_change":"2024-08-15T17:53:50.921735+0000","last_active":"2024-08-15T17:53:50.925176+0000","last_peered":"2024-08-15T17:53:50.925176+0000","last_clean":"2024-08-15T17:53:50.925176+0000","last_became_active":"2024-08-15T17:53:50.921323+0000","last_became_peered":"2024-08-15T17:53:50.921323+0000","last_unstale":"2024-08-15T17:53:50.925176+0000","last_undegraded":"2024-08-15T17:53:50.925176+0000","last_fullsized":"2024-08-15T17:53:50.925176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:36.650250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914480+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.914480+0000","last_peered":"2024-08-15T17:53:50.914480+0000","last_clean":"2024-08-15T17:53:50.914480+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.914480+0000","last_undegraded":"2024-08-15T17:53:50.914480+0000","last_fullsized":"2024-08-15T17:53:50.914480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911449+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.911449+0000","last_peered":"2024-08-15T17:53:50.911449+0000","last_clean":"2024-08-15T17:53:50.911449+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.911449+0000","last_undegraded":"2024-08-15T17:53:50.911449+0000","last_fullsized":"2024-08-15T17:53:50.911449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916933+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.916933+0000","last_peered":"2024-08-15T17:53:50.916933+0000","last_clean":"2024-08-15T17:53:50.916933+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.916933+0000","last_undegraded":"2024-08-15T17:53:50.916933+0000","last_fullsized":"2024-08-15T17:53:50.916933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922176+0000","last_change":"2024-08-15T17:53:50.916828+0000","last_active":"2024-08-15T17:53:50.922176+0000","last_peered":"2024-08-15T17:53:50.922176+0000","last_clean":"2024-08-15T17:53:50.922176+0000","last_became_active":"2024-08-15T17:53:50.916514+0000","last_became_peered":"2024-08-15T17:53:50.916514+0000","last_unstale":"2024-08-15T17:53:50.922176+0000","last_undegraded":"2024-08-15T17:53:50.922176+0000","last_fullsized":"2024-08-15T17:53:50.922176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:35:47.822736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914327+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.914327+0000","last_peered":"2024-08-15T17:53:50.914327+0000","last_clean":"2024-08-15T17:53:50.914327+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.914327+0000","last_undegraded":"2024-08-15T17:53:50.914327+0000","last_fullsized":"2024-08-15T17:53:50.914327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916688+0000","last_change":"2024-08-15T17:53:50.912831+0000","last_active":"2024-08-15T17:53:50.916688+0000","last_peered":"2024-08-15T17:53:50.916688+0000","last_clean":"2024-08-15T17:53:50.916688+0000","last_became_active":"2024-08-15T17:53:50.912616+0000","last_became_peered":"2024-08-15T17:53:50.912616+0000","last_unstale":"2024-08-15T17:53:50.916688+0000","last_undegraded":"2024-08-15T17:53:50.916688+0000","last_fullsized":"2024-08-15T17:53:50.916688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915811+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.915811+0000","last_peered":"2024-08-15T17:53:50.915811+0000","last_clean":"2024-08-15T17:53:50.915811+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.915811+0000","last_undegraded":"2024-08-15T17:53:50.915811+0000","last_fullsized":"2024-08-15T17:53:50.915811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925040+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.925040+0000","last_peered":"2024-08-15T17:53:50.925040+0000","last_clean":"2024-08-15T17:53:50.925040+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.925040+0000","last_undegraded":"2024-08-15T17:53:50.925040+0000","last_fullsized":"2024-08-15T17:53:50.925040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914159+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.914159+0000","last_peered":"2024-08-15T17:53:50.914159+0000","last_clean":"2024-08-15T17:53:50.914159+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.914159+0000","last_undegraded":"2024-08-15T17:53:50.914159+0000","last_fullsized":"2024-08-15T17:53:50.914159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932271+0000","last_change":"2024-08-15T17:53:49.909777+0000","last_active":"2024-08-15T17:53:50.932271+0000","last_peered":"2024-08-15T17:53:50.932271+0000","last_clean":"2024-08-15T17:53:50.932271+0000","last_became_active":"2024-08-15T17:53:49.909444+0000","last_became_peered":"2024-08-15T17:53:49.909444+0000","last_unstale":"2024-08-15T17:53:50.932271+0000","last_undegraded":"2024-08-15T17:53:50.932271+0000","last_fullsized":"2024-08-15T17:53:50.932271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.902509+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:50.902509+0000","last_peered":"2024-08-15T17:53:50.902509+0000","last_clean":"2024-08-15T17:53:50.902509+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:50.902509+0000","last_undegraded":"2024-08-15T17:53:50.902509+0000","last_fullsized":"2024-08-15T17:53:50.902509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.917061+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.917061+0000","last_peered":"2024-08-15T17:53:50.917061+0000","last_clean":"2024-08-15T17:53:50.917061+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.917061+0000","last_undegraded":"2024-08-15T17:53:50.917061+0000","last_fullsized":"2024-08-15T17:53:50.917061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.900928+0000","last_change":"2024-08-15T17:53:49.905568+0000","last_active":"2024-08-15T17:53:50.900928+0000","last_peered":"2024-08-15T17:53:50.900928+0000","last_clean":"2024-08-15T17:53:50.900928+0000","last_became_active":"2024-08-15T17:53:49.905264+0000","last_became_peered":"2024-08-15T17:53:49.905264+0000","last_unstale":"2024-08-15T17:53:50.900928+0000","last_undegraded":"2024-08-15T17:53:50.900928+0000","last_fullsized":"2024-08-15T17:53:50.900928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:45.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916759+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.916759+0000","last_peered":"2024-08-15T17:53:50.916759+0000","last_clean":"2024-08-15T17:53:50.916759+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.916759+0000","last_undegraded":"2024-08-15T17:53:50.916759+0000","last_fullsized":"2024-08-15T17:53:50.916759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907737+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:50.907737+0000","last_peered":"2024-08-15T17:53:50.907737+0000","last_clean":"2024-08-15T17:53:50.907737+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:50.907737+0000","last_undegraded":"2024-08-15T17:53:50.907737+0000","last_fullsized":"2024-08-15T17:53:50.907737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925197+0000","last_change":"2024-08-15T17:53:50.922614+0000","last_active":"2024-08-15T17:53:50.925197+0000","last_peered":"2024-08-15T17:53:50.925197+0000","last_clean":"2024-08-15T17:53:50.925197+0000","last_became_active":"2024-08-15T17:53:50.922233+0000","last_became_peered":"2024-08-15T17:53:50.922233+0000","last_unstale":"2024-08-15T17:53:50.925197+0000","last_undegraded":"2024-08-15T17:53:50.925197+0000","last_fullsized":"2024-08-15T17:53:50.925197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:41.928727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.891019+0000","last_change":"2024-08-15T17:53:49.902494+0000","last_active":"2024-08-15T17:53:50.891019+0000","last_peered":"2024-08-15T17:53:50.891019+0000","last_clean":"2024-08-15T17:53:50.891019+0000","last_became_active":"2024-08-15T17:53:49.902216+0000","last_became_peered":"2024-08-15T17:53:49.902216+0000","last_unstale":"2024-08-15T17:53:50.891019+0000","last_undegraded":"2024-08-15T17:53:50.891019+0000","last_fullsized":"2024-08-15T17:53:50.891019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909269+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.909269+0000","last_peered":"2024-08-15T17:53:50.909269+0000","last_clean":"2024-08-15T17:53:50.909269+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.909269+0000","last_undegraded":"2024-08-15T17:53:50.909269+0000","last_fullsized":"2024-08-15T17:53:50.909269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929796+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929796+0000","last_peered":"2024-08-15T17:53:50.929796+0000","last_clean":"2024-08-15T17:53:50.929796+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929796+0000","last_undegraded":"2024-08-15T17:53:50.929796+0000","last_fullsized":"2024-08-15T17:53:50.929796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926118+0000","last_change":"2024-08-15T17:53:50.919099+0000","last_active":"2024-08-15T17:53:50.926118+0000","last_peered":"2024-08-15T17:53:50.926118+0000","last_clean":"2024-08-15T17:53:50.926118+0000","last_became_active":"2024-08-15T17:53:50.918636+0000","last_became_peered":"2024-08-15T17:53:50.918636+0000","last_unstale":"2024-08-15T17:53:50.926118+0000","last_undegraded":"2024-08-15T17:53:50.926118+0000","last_fullsized":"2024-08-15T17:53:50.926118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.937468+0000","last_change":"2024-08-15T17:53:49.901002+0000","last_active":"2024-08-15T17:53:50.937468+0000","last_peered":"2024-08-15T17:53:50.937468+0000","last_clean":"2024-08-15T17:53:50.937468+0000","last_became_active":"2024-08-15T17:53:49.900687+0000","last_became_peered":"2024-08-15T17:53:49.900687+0000","last_unstale":"2024-08-15T17:53:50.937468+0000","last_undegraded":"2024-08-15T17:53:50.937468+0000","last_fullsized":"2024-08-15T17:53:50.937468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:00:56.507072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916662+0000","last_change":"2024-08-15T17:53:50.915295+0000","last_active":"2024-08-15T17:53:50.916662+0000","last_peered":"2024-08-15T17:53:50.916662+0000","last_clean":"2024-08-15T17:53:50.916662+0000","last_became_active":"2024-08-15T17:53:50.914142+0000","last_became_peered":"2024-08-15T17:53:50.914142+0000","last_unstale":"2024-08-15T17:53:50.916662+0000","last_undegraded":"2024-08-15T17:53:50.916662+0000","last_fullsized":"2024-08-15T17:53:50.916662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:56.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928512+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928512+0000","last_peered":"2024-08-15T17:53:50.928512+0000","last_clean":"2024-08-15T17:53:50.928512+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928512+0000","last_undegraded":"2024-08-15T17:53:50.928512+0000","last_fullsized":"2024-08-15T17:53:50.928512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922626+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.922626+0000","last_peered":"2024-08-15T17:53:50.922626+0000","last_clean":"2024-08-15T17:53:50.922626+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.922626+0000","last_undegraded":"2024-08-15T17:53:50.922626+0000","last_fullsized":"2024-08-15T17:53:50.922626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903791+0000","last_change":"2024-08-15T17:53:49.902363+0000","last_active":"2024-08-15T17:53:50.903791+0000","last_peered":"2024-08-15T17:53:50.903791+0000","last_clean":"2024-08-15T17:53:50.903791+0000","last_became_active":"2024-08-15T17:53:49.902061+0000","last_became_peered":"2024-08-15T17:53:49.902061+0000","last_unstale":"2024-08-15T17:53:50.903791+0000","last_undegraded":"2024-08-15T17:53:50.903791+0000","last_fullsized":"2024-08-15T17:53:50.903791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920873+0000","last_change":"2024-08-15T17:53:50.916048+0000","last_active":"2024-08-15T17:53:50.920873+0000","last_peered":"2024-08-15T17:53:50.920873+0000","last_clean":"2024-08-15T17:53:50.920873+0000","last_became_active":"2024-08-15T17:53:50.915821+0000","last_became_peered":"2024-08-15T17:53:50.915821+0000","last_unstale":"2024-08-15T17:53:50.920873+0000","last_undegraded":"2024-08-15T17:53:50.920873+0000","last_fullsized":"2024-08-15T17:53:50.920873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:52:59.537353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.889576+0000","last_change":"2024-08-15T17:53:49.906337+0000","last_active":"2024-08-15T17:53:50.889576+0000","last_peered":"2024-08-15T17:53:50.889576+0000","last_clean":"2024-08-15T17:53:50.889576+0000","last_became_active":"2024-08-15T17:53:49.906050+0000","last_became_peered":"2024-08-15T17:53:49.906050+0000","last_unstale":"2024-08-15T17:53:50.889576+0000","last_undegraded":"2024-08-15T17:53:50.889576+0000","last_fullsized":"2024-08-15T17:53:50.889576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913496+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.913496+0000","last_peered":"2024-08-15T17:53:50.913496+0000","last_clean":"2024-08-15T17:53:50.913496+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.913496+0000","last_undegraded":"2024-08-15T17:53:50.913496+0000","last_fullsized":"2024-08-15T17:53:50.913496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935231+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935231+0000","last_peered":"2024-08-15T17:53:50.935231+0000","last_clean":"2024-08-15T17:53:50.935231+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935231+0000","last_undegraded":"2024-08-15T17:53:50.935231+0000","last_fullsized":"2024-08-15T17:53:50.935231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926113+0000","last_change":"2024-08-15T17:53:50.918891+0000","last_active":"2024-08-15T17:53:50.926113+0000","last_peered":"2024-08-15T17:53:50.926113+0000","last_clean":"2024-08-15T17:53:50.926113+0000","last_became_active":"2024-08-15T17:53:50.918558+0000","last_became_peered":"2024-08-15T17:53:50.918558+0000","last_unstale":"2024-08-15T17:53:50.926113+0000","last_undegraded":"2024-08-15T17:53:50.926113+0000","last_fullsized":"2024-08-15T17:53:50.926113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927838+0000","last_change":"2024-08-15T17:53:49.911008+0000","last_active":"2024-08-15T17:53:50.927838+0000","last_peered":"2024-08-15T17:53:50.927838+0000","last_clean":"2024-08-15T17:53:50.927838+0000","last_became_active":"2024-08-15T17:53:49.910689+0000","last_became_peered":"2024-08-15T17:53:49.910689+0000","last_unstale":"2024-08-15T17:53:50.927838+0000","last_undegraded":"2024-08-15T17:53:50.927838+0000","last_fullsized":"2024-08-15T17:53:50.927838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907379+0000","last_change":"2024-08-15T17:53:50.904230+0000","last_active":"2024-08-15T17:53:50.907379+0000","last_peered":"2024-08-15T17:53:50.907379+0000","last_clean":"2024-08-15T17:53:50.907379+0000","last_became_active":"2024-08-15T17:53:50.903601+0000","last_became_peered":"2024-08-15T17:53:50.903601+0000","last_unstale":"2024-08-15T17:53:50.907379+0000","last_undegraded":"2024-08-15T17:53:50.907379+0000","last_fullsized":"2024-08-15T17:53:50.907379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:52.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927051+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.927051+0000","last_peered":"2024-08-15T17:53:50.927051+0000","last_clean":"2024-08-15T17:53:50.927051+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.927051+0000","last_undegraded":"2024-08-15T17:53:50.927051+0000","last_fullsized":"2024-08-15T17:53:50.927051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915634+0000","last_change":"2024-08-15T17:53:50.913859+0000","last_active":"2024-08-15T17:53:50.915634+0000","last_peered":"2024-08-15T17:53:50.915634+0000","last_clean":"2024-08-15T17:53:50.915634+0000","last_became_active":"2024-08-15T17:53:50.912444+0000","last_became_peered":"2024-08-15T17:53:50.912444+0000","last_unstale":"2024-08-15T17:53:50.915634+0000","last_undegraded":"2024-08-15T17:53:50.915634+0000","last_fullsized":"2024-08-15T17:53:50.915634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928230+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.928230+0000","last_peered":"2024-08-15T17:53:50.928230+0000","last_clean":"2024-08-15T17:53:50.928230+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.928230+0000","last_undegraded":"2024-08-15T17:53:50.928230+0000","last_fullsized":"2024-08-15T17:53:50.928230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915176+0000","last_change":"2024-08-15T17:53:50.907476+0000","last_active":"2024-08-15T17:53:50.915176+0000","last_peered":"2024-08-15T17:53:50.915176+0000","last_clean":"2024-08-15T17:53:50.915176+0000","last_became_active":"2024-08-15T17:53:50.907146+0000","last_became_peered":"2024-08-15T17:53:50.907146+0000","last_unstale":"2024-08-15T17:53:50.915176+0000","last_undegraded":"2024-08-15T17:53:50.915176+0000","last_fullsized":"2024-08-15T17:53:50.915176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:32:00.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906127+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:50.906127+0000","last_peered":"2024-08-15T17:53:50.906127+0000","last_clean":"2024-08-15T17:53:50.906127+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:50.906127+0000","last_undegraded":"2024-08-15T17:53:50.906127+0000","last_fullsized":"2024-08-15T17:53:50.906127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920590+0000","last_change":"2024-08-15T17:53:50.911334+0000","last_active":"2024-08-15T17:53:50.920590+0000","last_peered":"2024-08-15T17:53:50.920590+0000","last_clean":"2024-08-15T17:53:50.920590+0000","last_became_active":"2024-08-15T17:53:50.911063+0000","last_became_peered":"2024-08-15T17:53:50.911063+0000","last_unstale":"2024-08-15T17:53:50.920590+0000","last_undegraded":"2024-08-15T17:53:50.920590+0000","last_fullsized":"2024-08-15T17:53:50.920590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:43:02.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907635+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:50.907635+0000","last_peered":"2024-08-15T17:53:50.907635+0000","last_clean":"2024-08-15T17:53:50.907635+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:50.907635+0000","last_undegraded":"2024-08-15T17:53:50.907635+0000","last_fullsized":"2024-08-15T17:53:50.907635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901688+0000","last_change":"2024-08-15T17:53:49.903821+0000","last_active":"2024-08-15T17:53:50.901688+0000","last_peered":"2024-08-15T17:53:50.901688+0000","last_clean":"2024-08-15T17:53:50.901688+0000","last_became_active":"2024-08-15T17:53:49.903160+0000","last_became_peered":"2024-08-15T17:53:49.903160+0000","last_unstale":"2024-08-15T17:53:50.901688+0000","last_undegraded":"2024-08-15T17:53:50.901688+0000","last_fullsized":"2024-08-15T17:53:50.901688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:15.247369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914180+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.914180+0000","last_peered":"2024-08-15T17:53:50.914180+0000","last_clean":"2024-08-15T17:53:50.914180+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.914180+0000","last_undegraded":"2024-08-15T17:53:50.914180+0000","last_fullsized":"2024-08-15T17:53:50.914180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901032+0000","last_change":"2024-08-15T17:53:49.911873+0000","last_active":"2024-08-15T17:53:50.901032+0000","last_peered":"2024-08-15T17:53:50.901032+0000","last_clean":"2024-08-15T17:53:50.901032+0000","last_became_active":"2024-08-15T17:53:49.911498+0000","last_became_peered":"2024-08-15T17:53:49.911498+0000","last_unstale":"2024-08-15T17:53:50.901032+0000","last_undegraded":"2024-08-15T17:53:50.901032+0000","last_fullsized":"2024-08-15T17:53:50.901032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910897+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.910897+0000","last_peered":"2024-08-15T17:53:50.910897+0000","last_clean":"2024-08-15T17:53:50.910897+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.910897+0000","last_undegraded":"2024-08-15T17:53:50.910897+0000","last_fullsized":"2024-08-15T17:53:50.910897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893174+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:50.893174+0000","last_peered":"2024-08-15T17:53:50.893174+0000","last_clean":"2024-08-15T17:53:50.893174+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:50.893174+0000","last_undegraded":"2024-08-15T17:53:50.893174+0000","last_fullsized":"2024-08-15T17:53:50.893174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.917041+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.917041+0000","last_peered":"2024-08-15T17:53:50.917041+0000","last_clean":"2024-08-15T17:53:50.917041+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.917041+0000","last_undegraded":"2024-08-15T17:53:50.917041+0000","last_fullsized":"2024-08-15T17:53:50.917041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903922+0000","last_change":"2024-08-15T17:53:49.902223+0000","last_active":"2024-08-15T17:53:50.903922+0000","last_peered":"2024-08-15T17:53:50.903922+0000","last_clean":"2024-08-15T17:53:50.903922+0000","last_became_active":"2024-08-15T17:53:49.901891+0000","last_became_peered":"2024-08-15T17:53:49.901891+0000","last_unstale":"2024-08-15T17:53:50.903922+0000","last_undegraded":"2024-08-15T17:53:50.903922+0000","last_fullsized":"2024-08-15T17:53:50.903922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:35.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913818+0000","last_change":"2024-08-15T17:53:50.903676+0000","last_active":"2024-08-15T17:53:50.913818+0000","last_peered":"2024-08-15T17:53:50.913818+0000","last_clean":"2024-08-15T17:53:50.913818+0000","last_became_active":"2024-08-15T17:53:50.903374+0000","last_became_peered":"2024-08-15T17:53:50.903374+0000","last_unstale":"2024-08-15T17:53:50.913818+0000","last_undegraded":"2024-08-15T17:53:50.913818+0000","last_fullsized":"2024-08-15T17:53:50.913818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901086+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:50.901086+0000","last_peered":"2024-08-15T17:53:50.901086+0000","last_clean":"2024-08-15T17:53:50.901086+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:50.901086+0000","last_undegraded":"2024-08-15T17:53:50.901086+0000","last_fullsized":"2024-08-15T17:53:50.901086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916594+0000","last_change":"2024-08-15T17:53:50.909590+0000","last_active":"2024-08-15T17:53:50.916594+0000","last_peered":"2024-08-15T17:53:50.916594+0000","last_clean":"2024-08-15T17:53:50.916594+0000","last_became_active":"2024-08-15T17:53:50.908589+0000","last_became_peered":"2024-08-15T17:53:50.908589+0000","last_unstale":"2024-08-15T17:53:50.916594+0000","last_undegraded":"2024-08-15T17:53:50.916594+0000","last_fullsized":"2024-08-15T17:53:50.916594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:37.384281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901052+0000","last_change":"2024-08-15T17:53:49.902247+0000","last_active":"2024-08-15T17:53:50.901052+0000","last_peered":"2024-08-15T17:53:50.901052+0000","last_clean":"2024-08-15T17:53:50.901052+0000","last_became_active":"2024-08-15T17:53:49.901925+0000","last_became_peered":"2024-08-15T17:53:49.901925+0000","last_unstale":"2024-08-15T17:53:50.901052+0000","last_undegraded":"2024-08-15T17:53:50.901052+0000","last_fullsized":"2024-08-15T17:53:50.901052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911493+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.911493+0000","last_peered":"2024-08-15T17:53:50.911493+0000","last_clean":"2024-08-15T17:53:50.911493+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.911493+0000","last_undegraded":"2024-08-15T17:53:50.911493+0000","last_fullsized":"2024-08-15T17:53:50.911493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-15T17:53:52.711988+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:52.711988+0000","last_peered":"2024-08-15T17:53:52.711988+0000","last_clean":"2024-08-15T17:53:52.711988+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:52.711988+0000","last_undegraded":"2024-08-15T17:53:52.711988+0000","last_fullsized":"2024-08-15T17:53:52.711988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916680+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.916680+0000","last_peered":"2024-08-15T17:53:50.916680+0000","last_clean":"2024-08-15T17:53:50.916680+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.916680+0000","last_undegraded":"2024-08-15T17:53:50.916680+0000","last_fullsized":"2024-08-15T17:53:50.916680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932574+0000","last_change":"2024-08-15T17:53:49.909938+0000","last_active":"2024-08-15T17:53:50.932574+0000","last_peered":"2024-08-15T17:53:50.932574+0000","last_clean":"2024-08-15T17:53:50.932574+0000","last_became_active":"2024-08-15T17:53:49.909683+0000","last_became_peered":"2024-08-15T17:53:49.909683+0000","last_unstale":"2024-08-15T17:53:50.932574+0000","last_undegraded":"2024-08-15T17:53:50.932574+0000","last_fullsized":"2024-08-15T17:53:50.932574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:40.919685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916565+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.916565+0000","last_peered":"2024-08-15T17:53:50.916565+0000","last_clean":"2024-08-15T17:53:50.916565+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.916565+0000","last_undegraded":"2024-08-15T17:53:50.916565+0000","last_fullsized":"2024-08-15T17:53:50.916565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.889238+0000","last_change":"2024-08-15T17:53:49.906864+0000","last_active":"2024-08-15T17:53:50.889238+0000","last_peered":"2024-08-15T17:53:50.889238+0000","last_clean":"2024-08-15T17:53:50.889238+0000","last_became_active":"2024-08-15T17:53:49.906562+0000","last_became_peered":"2024-08-15T17:53:49.906562+0000","last_unstale":"2024-08-15T17:53:50.889238+0000","last_undegraded":"2024-08-15T17:53:50.889238+0000","last_fullsized":"2024-08-15T17:53:50.889238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920687+0000","last_change":"2024-08-15T17:53:50.914663+0000","last_active":"2024-08-15T17:53:50.920687+0000","last_peered":"2024-08-15T17:53:50.920687+0000","last_clean":"2024-08-15T17:53:50.920687+0000","last_became_active":"2024-08-15T17:53:50.914323+0000","last_became_peered":"2024-08-15T17:53:50.914323+0000","last_unstale":"2024-08-15T17:53:50.920687+0000","last_undegraded":"2024-08-15T17:53:50.920687+0000","last_fullsized":"2024-08-15T17:53:50.920687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893998+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:50.893998+0000","last_peered":"2024-08-15T17:53:50.893998+0000","last_clean":"2024-08-15T17:53:50.893998+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:50.893998+0000","last_undegraded":"2024-08-15T17:53:50.893998+0000","last_fullsized":"2024-08-15T17:53:50.893998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916724+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.916724+0000","last_peered":"2024-08-15T17:53:50.916724+0000","last_clean":"2024-08-15T17:53:50.916724+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.916724+0000","last_undegraded":"2024-08-15T17:53:50.916724+0000","last_fullsized":"2024-08-15T17:53:50.916724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905841+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:50.905841+0000","last_peered":"2024-08-15T17:53:50.905841+0000","last_clean":"2024-08-15T17:53:50.905841+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:50.905841+0000","last_undegraded":"2024-08-15T17:53:50.905841+0000","last_fullsized":"2024-08-15T17:53:50.905841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914395+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.914395+0000","last_peered":"2024-08-15T17:53:50.914395+0000","last_clean":"2024-08-15T17:53:50.914395+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.914395+0000","last_undegraded":"2024-08-15T17:53:50.914395+0000","last_fullsized":"2024-08-15T17:53:50.914395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.930230+0000","last_change":"2024-08-15T17:53:49.903999+0000","last_active":"2024-08-15T17:53:50.930230+0000","last_peered":"2024-08-15T17:53:50.930230+0000","last_clean":"2024-08-15T17:53:50.930230+0000","last_became_active":"2024-08-15T17:53:49.903565+0000","last_became_peered":"2024-08-15T17:53:49.903565+0000","last_unstale":"2024-08-15T17:53:50.930230+0000","last_undegraded":"2024-08-15T17:53:50.930230+0000","last_fullsized":"2024-08-15T17:53:50.930230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:04:25.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926035+0000","last_change":"2024-08-15T17:53:50.918330+0000","last_active":"2024-08-15T17:53:50.926035+0000","last_peered":"2024-08-15T17:53:50.926035+0000","last_clean":"2024-08-15T17:53:50.926035+0000","last_became_active":"2024-08-15T17:53:50.917987+0000","last_became_peered":"2024-08-15T17:53:50.917987+0000","last_unstale":"2024-08-15T17:53:50.926035+0000","last_undegraded":"2024-08-15T17:53:50.926035+0000","last_fullsized":"2024-08-15T17:53:50.926035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:58:12.793849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920381+0000","last_change":"2024-08-15T17:53:50.909037+0000","last_active":"2024-08-15T17:53:50.920381+0000","last_peered":"2024-08-15T17:53:50.920381+0000","last_clean":"2024-08-15T17:53:50.920381+0000","last_became_active":"2024-08-15T17:53:50.908705+0000","last_became_peered":"2024-08-15T17:53:50.908705+0000","last_unstale":"2024-08-15T17:53:50.920381+0000","last_undegraded":"2024-08-15T17:53:50.920381+0000","last_fullsized":"2024-08-15T17:53:50.920381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:50:09.164360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928245+0000","last_change":"2024-08-15T17:53:49.902233+0000","last_active":"2024-08-15T17:53:50.928245+0000","last_peered":"2024-08-15T17:53:50.928245+0000","last_clean":"2024-08-15T17:53:50.928245+0000","last_became_active":"2024-08-15T17:53:49.901894+0000","last_became_peered":"2024-08-15T17:53:49.901894+0000","last_unstale":"2024-08-15T17:53:50.928245+0000","last_undegraded":"2024-08-15T17:53:50.928245+0000","last_fullsized":"2024-08-15T17:53:50.928245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916585+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.916585+0000","last_peered":"2024-08-15T17:53:50.916585+0000","last_clean":"2024-08-15T17:53:50.916585+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.916585+0000","last_undegraded":"2024-08-15T17:53:50.916585+0000","last_fullsized":"2024-08-15T17:53:50.916585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928119+0000","last_change":"2024-08-15T17:53:49.902248+0000","last_active":"2024-08-15T17:53:50.928119+0000","last_peered":"2024-08-15T17:53:50.928119+0000","last_clean":"2024-08-15T17:53:50.928119+0000","last_became_active":"2024-08-15T17:53:49.901911+0000","last_became_peered":"2024-08-15T17:53:49.901911+0000","last_unstale":"2024-08-15T17:53:50.928119+0000","last_undegraded":"2024-08-15T17:53:50.928119+0000","last_fullsized":"2024-08-15T17:53:50.928119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916752+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.916752+0000","last_peered":"2024-08-15T17:53:50.916752+0000","last_clean":"2024-08-15T17:53:50.916752+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.916752+0000","last_undegraded":"2024-08-15T17:53:50.916752+0000","last_fullsized":"2024-08-15T17:53:50.916752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926596+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.926596+0000","last_peered":"2024-08-15T17:53:50.926596+0000","last_clean":"2024-08-15T17:53:50.926596+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.926596+0000","last_undegraded":"2024-08-15T17:53:50.926596+0000","last_fullsized":"2024-08-15T17:53:50.926596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910788+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.910788+0000","last_peered":"2024-08-15T17:53:50.910788+0000","last_clean":"2024-08-15T17:53:50.910788+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.910788+0000","last_undegraded":"2024-08-15T17:53:50.910788+0000","last_fullsized":"2024-08-15T17:53:50.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929149+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.929149+0000","last_peered":"2024-08-15T17:53:50.929149+0000","last_clean":"2024-08-15T17:53:50.929149+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.929149+0000","last_undegraded":"2024-08-15T17:53:50.929149+0000","last_fullsized":"2024-08-15T17:53:50.929149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":212992,"data_stored":73445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":72931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":72875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":663335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":806912,"data_stored":663313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:54:02.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:54:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 Processor -- start 2024-08-15T17:54:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- start start 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fca340b0d20 0x7fca3406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca3406e450 0x7fca340b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b1630 0x7fca341610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca34141a00 con 0x7fca340b0d20 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3406e8a0 con 0x7fca3406e450 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca34140b10 con 0x7fca340b1630 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fca340b0d20 0x7fca3406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fca340b0d20 0x7fca3406df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35554/0 (socket says 172.21.15.33:35554) 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 -- 172.21.15.33:0/3792375989 learned_addr learned my addr 172.21.15.33:0/3792375989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3aa88700 1 --2- 172.21.15.33:0/3792375989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b1630 0x7fca341610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca39a86700 1 --2- 172.21.15.33:0/3792375989 >> v2:172.21.15.105:3300/0 conn(0x7fca3406e450 0x7fca340b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 -- 172.21.15.33:0/3792375989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b1630 msgr2=0x7fca341610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 --2- 172.21.15.33:0/3792375989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b1630 0x7fca341610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 -- 172.21.15.33:0/3792375989 >> v2:172.21.15.105:3300/0 conn(0x7fca3406e450 msgr2=0x7fca340b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 --2- 172.21.15.33:0/3792375989 >> v2:172.21.15.105:3300/0 conn(0x7fca3406e450 0x7fca340b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 -- 172.21.15.33:0/3792375989 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca34140df0 con 0x7fca340b0d20 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3a287700 1 --2- 172.21.15.33:0/3792375989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca340b0d20 0x7fca3406df10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca3406c630 tx=0x7fca24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131ee5dad68dd792 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca39285700 1 -- 172.21.15.33:0/3792375989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400e070 con 0x7fca340b0d20 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca39285700 1 -- 172.21.15.33:0/3792375989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2400ba50 con 0x7fca340b0d20 2024-08-15T17:54:02.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca39285700 1 -- 172.21.15.33:0/3792375989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240092e0 con 0x7fca340b0d20 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- 172.21.15.33:0/3792375989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca340b0d20 msgr2=0x7fca3406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- 172.21.15.33:0/3792375989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca340b0d20 0x7fca3406df10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca3406c630 tx=0x7fca24009840 comp rx=0 tx=0).stop 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- 172.21.15.33:0/3792375989 shutdown_connections 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- 172.21.15.33:0/3792375989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b1630 0x7fca341610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- 172.21.15.33:0/3792375989 >> v2:172.21.15.105:3300/0 conn(0x7fca3406e450 0x7fca340b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 --2- 172.21.15.33:0/3792375989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca340b0d20 0x7fca3406df10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- 172.21.15.33:0/3792375989 >> 172.21.15.33:0/3792375989 conn(0x7fca340678d0 msgr2=0x7fca34067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- 172.21.15.33:0/3792375989 shutdown_connections 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.487+0000 7fca3b289700 1 -- 172.21.15.33:0/3792375989 wait complete. 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 Processor -- start 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- start start 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 0x7fca340a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b0d20 0x7fca34170590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca340b1630 0x7fca3415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340a8270 con 0x7fca3406e450 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340a75f0 con 0x7fca340b1630 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340a78d0 con 0x7fca340b0d20 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 0x7fca340a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 0x7fca340a61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35570/0 (socket says 172.21.15.33:35570) 2024-08-15T17:54:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 -- 172.21.15.33:0/1543982669 learned_addr learned my addr 172.21.15.33:0/1543982669 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3aa88700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca340b1630 0x7fca3415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca39a86700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b0d20 0x7fca34170590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 -- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b0d20 msgr2=0x7fca34170590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b0d20 0x7fca34170590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 -- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca340b1630 msgr2=0x7fca3415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca340b1630 0x7fca3415ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 -- 172.21.15.33:0/1543982669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24009ae0 con 0x7fca3406e450 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3aa88700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca340b1630 0x7fca3415ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3a287700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 0x7fca340a61b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca3406c2d0 tx=0x7fca24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24008bb0 con 0x7fca3406e450 2024-08-15T17:54:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24008d50 con 0x7fca3406e450 2024-08-15T17:54:02.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca340a7bb0 con 0x7fca3406e450 2024-08-15T17:54:02.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2401c660 con 0x7fca3406e450 2024-08-15T17:54:02.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca340a66f0 con 0x7fca3406e450 2024-08-15T17:54:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.491+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca340643a0 con 0x7fca3406e450 2024-08-15T17:54:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.495+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fca24003040 con 0x7fca3406e450 2024-08-15T17:54:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.495+0000 7fca327fc700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fca20060860 0x7fca20062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.495+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca2407e2c0 con 0x7fca3406e450 2024-08-15T17:54:02.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.495+0000 7fca39a86700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fca20060860 0x7fca20062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.495+0000 7fca39a86700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fca20060860 0x7fca20062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca340cafa0 tx=0x7fca28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.503+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fca2404e710 con 0x7fca3406e450 2024-08-15T17:54:02.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.655+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca3406f5f0 con 0x7fca20060860 2024-08-15T17:54:02.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.671+0000 7fca327fc700 1 -- 172.21.15.33:0/1543982669 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264363 (secure 0 0 0) 0x7fca3406f5f0 con 0x7fca20060860 2024-08-15T17:54:02.675 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fca20060860 msgr2=0x7fca20062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fca20060860 0x7fca20062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca340cafa0 tx=0x7fca28008040 comp rx=0 tx=0).stop 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 msgr2=0x7fca340a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 0x7fca340a61b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca3406c2d0 tx=0x7fca24018000 comp rx=0 tx=0).stop 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 shutdown_connections 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fca20060860 0x7fca20062d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca340b1630 0x7fca3415ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca340b0d20 0x7fca34170590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 --2- 172.21.15.33:0/1543982669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3406e450 0x7fca340a61b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 >> 172.21.15.33:0/1543982669 conn(0x7fca340678d0 msgr2=0x7fca34142bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 shutdown_connections 2024-08-15T17:54:02.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.675+0000 7fca3b289700 1 -- 172.21.15.33:0/1543982669 wait complete. 2024-08-15T17:54:02.679 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:54:02.689 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-08-15T17:54:02.241424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385896,"kb_used_data":2856,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588824,"statfs":{"total":773094113280,"available":770650955776,"internally_reserved":0,"allocated":2924544,"data_stored":1768412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1574,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.353033"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915754+0000","last_change":"2024-08-15T17:53:50.914055+0000","last_active":"2024-08-15T17:53:50.915754+0000","last_peered":"2024-08-15T17:53:50.915754+0000","last_clean":"2024-08-15T17:53:50.915754+0000","last_became_active":"2024-08-15T17:53:50.912515+0000","last_became_peered":"2024-08-15T17:53:50.912515+0000","last_unstale":"2024-08-15T17:53:50.915754+0000","last_undegraded":"2024-08-15T17:53:50.915754+0000","last_fullsized":"2024-08-15T17:53:50.915754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916931+0000","last_change":"2024-08-15T17:53:50.911772+0000","last_active":"2024-08-15T17:53:50.916931+0000","last_peered":"2024-08-15T17:53:50.916931+0000","last_clean":"2024-08-15T17:53:50.916931+0000","last_became_active":"2024-08-15T17:53:50.911489+0000","last_became_peered":"2024-08-15T17:53:50.911489+0000","last_unstale":"2024-08-15T17:53:50.916931+0000","last_undegraded":"2024-08-15T17:53:50.916931+0000","last_fullsized":"2024-08-15T17:53:50.916931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:06:02.714189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.919237+0000","last_change":"2024-08-15T17:53:50.915015+0000","last_active":"2024-08-15T17:53:50.919237+0000","last_peered":"2024-08-15T17:53:50.919237+0000","last_clean":"2024-08-15T17:53:50.919237+0000","last_became_active":"2024-08-15T17:53:50.914628+0000","last_became_peered":"2024-08-15T17:53:50.914628+0000","last_unstale":"2024-08-15T17:53:50.919237+0000","last_undegraded":"2024-08-15T17:53:50.919237+0000","last_fullsized":"2024-08-15T17:53:50.919237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:58.545252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921467+0000","last_change":"2024-08-15T17:53:50.914898+0000","last_active":"2024-08-15T17:53:50.921467+0000","last_peered":"2024-08-15T17:53:50.921467+0000","last_clean":"2024-08-15T17:53:50.921467+0000","last_became_active":"2024-08-15T17:53:50.914603+0000","last_became_peered":"2024-08-15T17:53:50.914603+0000","last_unstale":"2024-08-15T17:53:50.921467+0000","last_undegraded":"2024-08-15T17:53:50.921467+0000","last_fullsized":"2024-08-15T17:53:50.921467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:11.104066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913847+0000","last_change":"2024-08-15T17:53:50.904384+0000","last_active":"2024-08-15T17:53:50.913847+0000","last_peered":"2024-08-15T17:53:50.913847+0000","last_clean":"2024-08-15T17:53:50.913847+0000","last_became_active":"2024-08-15T17:53:50.904058+0000","last_became_peered":"2024-08-15T17:53:50.904058+0000","last_unstale":"2024-08-15T17:53:50.913847+0000","last_undegraded":"2024-08-15T17:53:50.913847+0000","last_fullsized":"2024-08-15T17:53:50.913847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.921547+0000","last_change":"2024-08-15T17:53:50.914850+0000","last_active":"2024-08-15T17:53:50.921547+0000","last_peered":"2024-08-15T17:53:50.921547+0000","last_clean":"2024-08-15T17:53:50.921547+0000","last_became_active":"2024-08-15T17:53:50.914627+0000","last_became_peered":"2024-08-15T17:53:50.914627+0000","last_unstale":"2024-08-15T17:53:50.921547+0000","last_undegraded":"2024-08-15T17:53:50.921547+0000","last_fullsized":"2024-08-15T17:53:50.921547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913990+0000","last_change":"2024-08-15T17:53:50.906406+0000","last_active":"2024-08-15T17:53:50.913990+0000","last_peered":"2024-08-15T17:53:50.913990+0000","last_clean":"2024-08-15T17:53:50.913990+0000","last_became_active":"2024-08-15T17:53:50.906100+0000","last_became_peered":"2024-08-15T17:53:50.906100+0000","last_unstale":"2024-08-15T17:53:50.913990+0000","last_undegraded":"2024-08-15T17:53:50.913990+0000","last_fullsized":"2024-08-15T17:53:50.913990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:13.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909252+0000","last_change":"2024-08-15T17:53:50.905096+0000","last_active":"2024-08-15T17:53:50.909252+0000","last_peered":"2024-08-15T17:53:50.909252+0000","last_clean":"2024-08-15T17:53:50.909252+0000","last_became_active":"2024-08-15T17:53:50.904296+0000","last_became_peered":"2024-08-15T17:53:50.904296+0000","last_unstale":"2024-08-15T17:53:50.909252+0000","last_undegraded":"2024-08-15T17:53:50.909252+0000","last_fullsized":"2024-08-15T17:53:50.909252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:25:42.473893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.924946+0000","last_change":"2024-08-15T17:53:50.921521+0000","last_active":"2024-08-15T17:53:50.924946+0000","last_peered":"2024-08-15T17:53:50.924946+0000","last_clean":"2024-08-15T17:53:50.924946+0000","last_became_active":"2024-08-15T17:53:50.921181+0000","last_became_peered":"2024-08-15T17:53:50.921181+0000","last_unstale":"2024-08-15T17:53:50.924946+0000","last_undegraded":"2024-08-15T17:53:50.924946+0000","last_fullsized":"2024-08-15T17:53:50.924946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913903+0000","last_change":"2024-08-15T17:53:50.903622+0000","last_active":"2024-08-15T17:53:50.913903+0000","last_peered":"2024-08-15T17:53:50.913903+0000","last_clean":"2024-08-15T17:53:50.913903+0000","last_became_active":"2024-08-15T17:53:50.903273+0000","last_became_peered":"2024-08-15T17:53:50.903273+0000","last_unstale":"2024-08-15T17:53:50.913903+0000","last_undegraded":"2024-08-15T17:53:50.913903+0000","last_fullsized":"2024-08-15T17:53:50.913903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915664+0000","last_change":"2024-08-15T17:53:50.913949+0000","last_active":"2024-08-15T17:53:50.915664+0000","last_peered":"2024-08-15T17:53:50.915664+0000","last_clean":"2024-08-15T17:53:50.915664+0000","last_became_active":"2024-08-15T17:53:50.912318+0000","last_became_peered":"2024-08-15T17:53:50.912318+0000","last_unstale":"2024-08-15T17:53:50.915664+0000","last_undegraded":"2024-08-15T17:53:50.915664+0000","last_fullsized":"2024-08-15T17:53:50.915664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916410+0000","last_change":"2024-08-15T17:53:50.914253+0000","last_active":"2024-08-15T17:53:50.916410+0000","last_peered":"2024-08-15T17:53:50.916410+0000","last_clean":"2024-08-15T17:53:50.916410+0000","last_became_active":"2024-08-15T17:53:50.912891+0000","last_became_peered":"2024-08-15T17:53:50.912891+0000","last_unstale":"2024-08-15T17:53:50.916410+0000","last_undegraded":"2024-08-15T17:53:50.916410+0000","last_fullsized":"2024-08-15T17:53:50.916410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:50:46.552157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911666+0000","last_change":"2024-08-15T17:53:50.910014+0000","last_active":"2024-08-15T17:53:50.911666+0000","last_peered":"2024-08-15T17:53:50.911666+0000","last_clean":"2024-08-15T17:53:50.911666+0000","last_became_active":"2024-08-15T17:53:50.909723+0000","last_became_peered":"2024-08-15T17:53:50.909723+0000","last_unstale":"2024-08-15T17:53:50.911666+0000","last_undegraded":"2024-08-15T17:53:50.911666+0000","last_fullsized":"2024-08-15T17:53:50.911666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:45:45.242620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914568+0000","last_change":"2024-08-15T17:53:50.912445+0000","last_active":"2024-08-15T17:53:50.914568+0000","last_peered":"2024-08-15T17:53:50.914568+0000","last_clean":"2024-08-15T17:53:50.914568+0000","last_became_active":"2024-08-15T17:53:50.912083+0000","last_became_peered":"2024-08-15T17:53:50.912083+0000","last_unstale":"2024-08-15T17:53:50.914568+0000","last_undegraded":"2024-08-15T17:53:50.914568+0000","last_fullsized":"2024-08-15T17:53:50.914568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910692+0000","last_change":"2024-08-15T17:53:50.907943+0000","last_active":"2024-08-15T17:53:50.910692+0000","last_peered":"2024-08-15T17:53:50.910692+0000","last_clean":"2024-08-15T17:53:50.910692+0000","last_became_active":"2024-08-15T17:53:50.907652+0000","last_became_peered":"2024-08-15T17:53:50.907652+0000","last_unstale":"2024-08-15T17:53:50.910692+0000","last_undegraded":"2024-08-15T17:53:50.910692+0000","last_fullsized":"2024-08-15T17:53:50.910692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:28.816835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926051+0000","last_change":"2024-08-15T17:53:50.918930+0000","last_active":"2024-08-15T17:53:50.926051+0000","last_peered":"2024-08-15T17:53:50.926051+0000","last_clean":"2024-08-15T17:53:50.926051+0000","last_became_active":"2024-08-15T17:53:50.918540+0000","last_became_peered":"2024-08-15T17:53:50.918540+0000","last_unstale":"2024-08-15T17:53:50.926051+0000","last_undegraded":"2024-08-15T17:53:50.926051+0000","last_fullsized":"2024-08-15T17:53:50.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:47:00.308854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925996+0000","last_change":"2024-08-15T17:53:50.918137+0000","last_active":"2024-08-15T17:53:50.925996+0000","last_peered":"2024-08-15T17:53:50.925996+0000","last_clean":"2024-08-15T17:53:50.925996+0000","last_became_active":"2024-08-15T17:53:50.917839+0000","last_became_peered":"2024-08-15T17:53:50.917839+0000","last_unstale":"2024-08-15T17:53:50.925996+0000","last_undegraded":"2024-08-15T17:53:50.925996+0000","last_fullsized":"2024-08-15T17:53:50.925996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:47:03.604696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.912296+0000","last_change":"2024-08-15T17:53:50.903857+0000","last_active":"2024-08-15T17:53:50.912296+0000","last_peered":"2024-08-15T17:53:50.912296+0000","last_clean":"2024-08-15T17:53:50.912296+0000","last_became_active":"2024-08-15T17:53:50.903560+0000","last_became_peered":"2024-08-15T17:53:50.903560+0000","last_unstale":"2024-08-15T17:53:50.912296+0000","last_undegraded":"2024-08-15T17:53:50.912296+0000","last_fullsized":"2024-08-15T17:53:50.912296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:25:06.777100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922087+0000","last_change":"2024-08-15T17:53:50.915095+0000","last_active":"2024-08-15T17:53:50.922087+0000","last_peered":"2024-08-15T17:53:50.922087+0000","last_clean":"2024-08-15T17:53:50.922087+0000","last_became_active":"2024-08-15T17:53:50.914811+0000","last_became_peered":"2024-08-15T17:53:50.914811+0000","last_unstale":"2024-08-15T17:53:50.922087+0000","last_undegraded":"2024-08-15T17:53:50.922087+0000","last_fullsized":"2024-08-15T17:53:50.922087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:39:08.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915199+0000","last_change":"2024-08-15T17:53:50.911317+0000","last_active":"2024-08-15T17:53:50.915199+0000","last_peered":"2024-08-15T17:53:50.915199+0000","last_clean":"2024-08-15T17:53:50.915199+0000","last_became_active":"2024-08-15T17:53:50.910983+0000","last_became_peered":"2024-08-15T17:53:50.910983+0000","last_unstale":"2024-08-15T17:53:50.915199+0000","last_undegraded":"2024-08-15T17:53:50.915199+0000","last_fullsized":"2024-08-15T17:53:50.915199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:17:53.857852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914138+0000","last_change":"2024-08-15T17:53:50.905188+0000","last_active":"2024-08-15T17:53:50.914138+0000","last_peered":"2024-08-15T17:53:50.914138+0000","last_clean":"2024-08-15T17:53:50.914138+0000","last_became_active":"2024-08-15T17:53:50.904878+0000","last_became_peered":"2024-08-15T17:53:50.904878+0000","last_unstale":"2024-08-15T17:53:50.914138+0000","last_undegraded":"2024-08-15T17:53:50.914138+0000","last_fullsized":"2024-08-15T17:53:50.914138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:35:58.671893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922366+0000","last_change":"2024-08-15T17:53:50.916679+0000","last_active":"2024-08-15T17:53:50.922366+0000","last_peered":"2024-08-15T17:53:50.922366+0000","last_clean":"2024-08-15T17:53:50.922366+0000","last_became_active":"2024-08-15T17:53:50.916413+0000","last_became_peered":"2024-08-15T17:53:50.916413+0000","last_unstale":"2024-08-15T17:53:50.922366+0000","last_undegraded":"2024-08-15T17:53:50.922366+0000","last_fullsized":"2024-08-15T17:53:50.922366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:14:51.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909117+0000","last_change":"2024-08-15T17:53:50.903300+0000","last_active":"2024-08-15T17:53:50.909117+0000","last_peered":"2024-08-15T17:53:50.909117+0000","last_clean":"2024-08-15T17:53:50.909117+0000","last_became_active":"2024-08-15T17:53:50.902960+0000","last_became_peered":"2024-08-15T17:53:50.902960+0000","last_unstale":"2024-08-15T17:53:50.909117+0000","last_undegraded":"2024-08-15T17:53:50.909117+0000","last_fullsized":"2024-08-15T17:53:50.909117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920128+0000","last_change":"2024-08-15T17:53:50.908561+0000","last_active":"2024-08-15T17:53:50.920128+0000","last_peered":"2024-08-15T17:53:50.920128+0000","last_clean":"2024-08-15T17:53:50.920128+0000","last_became_active":"2024-08-15T17:53:50.908263+0000","last_became_peered":"2024-08-15T17:53:50.908263+0000","last_unstale":"2024-08-15T17:53:50.920128+0000","last_undegraded":"2024-08-15T17:53:50.920128+0000","last_fullsized":"2024-08-15T17:53:50.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:07:38.806189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916877+0000","last_change":"2024-08-15T17:53:50.911467+0000","last_active":"2024-08-15T17:53:50.916877+0000","last_peered":"2024-08-15T17:53:50.916877+0000","last_clean":"2024-08-15T17:53:50.916877+0000","last_became_active":"2024-08-15T17:53:50.911147+0000","last_became_peered":"2024-08-15T17:53:50.911147+0000","last_unstale":"2024-08-15T17:53:50.916877+0000","last_undegraded":"2024-08-15T17:53:50.916877+0000","last_fullsized":"2024-08-15T17:53:50.916877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:34:08.507949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925176+0000","last_change":"2024-08-15T17:53:50.921735+0000","last_active":"2024-08-15T17:53:50.925176+0000","last_peered":"2024-08-15T17:53:50.925176+0000","last_clean":"2024-08-15T17:53:50.925176+0000","last_became_active":"2024-08-15T17:53:50.921323+0000","last_became_peered":"2024-08-15T17:53:50.921323+0000","last_unstale":"2024-08-15T17:53:50.925176+0000","last_undegraded":"2024-08-15T17:53:50.925176+0000","last_fullsized":"2024-08-15T17:53:50.925176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:36.650250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914480+0000","last_change":"2024-08-15T17:53:50.913215+0000","last_active":"2024-08-15T17:53:50.914480+0000","last_peered":"2024-08-15T17:53:50.914480+0000","last_clean":"2024-08-15T17:53:50.914480+0000","last_became_active":"2024-08-15T17:53:50.912009+0000","last_became_peered":"2024-08-15T17:53:50.912009+0000","last_unstale":"2024-08-15T17:53:50.914480+0000","last_undegraded":"2024-08-15T17:53:50.914480+0000","last_fullsized":"2024-08-15T17:53:50.914480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:29:20.453289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911449+0000","last_change":"2024-08-15T17:53:50.907121+0000","last_active":"2024-08-15T17:53:50.911449+0000","last_peered":"2024-08-15T17:53:50.911449+0000","last_clean":"2024-08-15T17:53:50.911449+0000","last_became_active":"2024-08-15T17:53:50.906842+0000","last_became_peered":"2024-08-15T17:53:50.906842+0000","last_unstale":"2024-08-15T17:53:50.911449+0000","last_undegraded":"2024-08-15T17:53:50.911449+0000","last_fullsized":"2024-08-15T17:53:50.911449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:34:22.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916933+0000","last_change":"2024-08-15T17:53:50.912441+0000","last_active":"2024-08-15T17:53:50.916933+0000","last_peered":"2024-08-15T17:53:50.916933+0000","last_clean":"2024-08-15T17:53:50.916933+0000","last_became_active":"2024-08-15T17:53:50.912120+0000","last_became_peered":"2024-08-15T17:53:50.912120+0000","last_unstale":"2024-08-15T17:53:50.916933+0000","last_undegraded":"2024-08-15T17:53:50.916933+0000","last_fullsized":"2024-08-15T17:53:50.916933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:59:12.816148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922176+0000","last_change":"2024-08-15T17:53:50.916828+0000","last_active":"2024-08-15T17:53:50.922176+0000","last_peered":"2024-08-15T17:53:50.922176+0000","last_clean":"2024-08-15T17:53:50.922176+0000","last_became_active":"2024-08-15T17:53:50.916514+0000","last_became_peered":"2024-08-15T17:53:50.916514+0000","last_unstale":"2024-08-15T17:53:50.922176+0000","last_undegraded":"2024-08-15T17:53:50.922176+0000","last_fullsized":"2024-08-15T17:53:50.922176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:35:47.822736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914327+0000","last_change":"2024-08-15T17:53:50.910305+0000","last_active":"2024-08-15T17:53:50.914327+0000","last_peered":"2024-08-15T17:53:50.914327+0000","last_clean":"2024-08-15T17:53:50.914327+0000","last_became_active":"2024-08-15T17:53:50.910025+0000","last_became_peered":"2024-08-15T17:53:50.910025+0000","last_unstale":"2024-08-15T17:53:50.914327+0000","last_undegraded":"2024-08-15T17:53:50.914327+0000","last_fullsized":"2024-08-15T17:53:50.914327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916688+0000","last_change":"2024-08-15T17:53:50.912831+0000","last_active":"2024-08-15T17:53:50.916688+0000","last_peered":"2024-08-15T17:53:50.916688+0000","last_clean":"2024-08-15T17:53:50.916688+0000","last_became_active":"2024-08-15T17:53:50.912616+0000","last_became_peered":"2024-08-15T17:53:50.912616+0000","last_unstale":"2024-08-15T17:53:50.916688+0000","last_undegraded":"2024-08-15T17:53:50.916688+0000","last_fullsized":"2024-08-15T17:53:50.916688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915811+0000","last_change":"2024-08-15T17:53:50.912383+0000","last_active":"2024-08-15T17:53:50.915811+0000","last_peered":"2024-08-15T17:53:50.915811+0000","last_clean":"2024-08-15T17:53:50.915811+0000","last_became_active":"2024-08-15T17:53:50.912088+0000","last_became_peered":"2024-08-15T17:53:50.912088+0000","last_unstale":"2024-08-15T17:53:50.915811+0000","last_undegraded":"2024-08-15T17:53:50.915811+0000","last_fullsized":"2024-08-15T17:53:50.915811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:16.790520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925040+0000","last_change":"2024-08-15T17:53:49.905881+0000","last_active":"2024-08-15T17:53:50.925040+0000","last_peered":"2024-08-15T17:53:50.925040+0000","last_clean":"2024-08-15T17:53:50.925040+0000","last_became_active":"2024-08-15T17:53:49.905559+0000","last_became_peered":"2024-08-15T17:53:49.905559+0000","last_unstale":"2024-08-15T17:53:50.925040+0000","last_undegraded":"2024-08-15T17:53:50.925040+0000","last_fullsized":"2024-08-15T17:53:50.925040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914159+0000","last_change":"2024-08-15T17:53:50.905354+0000","last_active":"2024-08-15T17:53:50.914159+0000","last_peered":"2024-08-15T17:53:50.914159+0000","last_clean":"2024-08-15T17:53:50.914159+0000","last_became_active":"2024-08-15T17:53:50.905068+0000","last_became_peered":"2024-08-15T17:53:50.905068+0000","last_unstale":"2024-08-15T17:53:50.914159+0000","last_undegraded":"2024-08-15T17:53:50.914159+0000","last_fullsized":"2024-08-15T17:53:50.914159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:19:18.317504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932271+0000","last_change":"2024-08-15T17:53:49.909777+0000","last_active":"2024-08-15T17:53:50.932271+0000","last_peered":"2024-08-15T17:53:50.932271+0000","last_clean":"2024-08-15T17:53:50.932271+0000","last_became_active":"2024-08-15T17:53:49.909444+0000","last_became_peered":"2024-08-15T17:53:49.909444+0000","last_unstale":"2024-08-15T17:53:50.932271+0000","last_undegraded":"2024-08-15T17:53:50.932271+0000","last_fullsized":"2024-08-15T17:53:50.932271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.902509+0000","last_change":"2024-08-15T17:53:49.910030+0000","last_active":"2024-08-15T17:53:50.902509+0000","last_peered":"2024-08-15T17:53:50.902509+0000","last_clean":"2024-08-15T17:53:50.902509+0000","last_became_active":"2024-08-15T17:53:49.909718+0000","last_became_peered":"2024-08-15T17:53:49.909718+0000","last_unstale":"2024-08-15T17:53:50.902509+0000","last_undegraded":"2024-08-15T17:53:50.902509+0000","last_fullsized":"2024-08-15T17:53:50.902509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:49:25.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.917061+0000","last_change":"2024-08-15T17:53:50.913318+0000","last_active":"2024-08-15T17:53:50.917061+0000","last_peered":"2024-08-15T17:53:50.917061+0000","last_clean":"2024-08-15T17:53:50.917061+0000","last_became_active":"2024-08-15T17:53:50.912865+0000","last_became_peered":"2024-08-15T17:53:50.912865+0000","last_unstale":"2024-08-15T17:53:50.917061+0000","last_undegraded":"2024-08-15T17:53:50.917061+0000","last_fullsized":"2024-08-15T17:53:50.917061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:12.457301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.900928+0000","last_change":"2024-08-15T17:53:49.905568+0000","last_active":"2024-08-15T17:53:50.900928+0000","last_peered":"2024-08-15T17:53:50.900928+0000","last_clean":"2024-08-15T17:53:50.900928+0000","last_became_active":"2024-08-15T17:53:49.905264+0000","last_became_peered":"2024-08-15T17:53:49.905264+0000","last_unstale":"2024-08-15T17:53:50.900928+0000","last_undegraded":"2024-08-15T17:53:50.900928+0000","last_fullsized":"2024-08-15T17:53:50.900928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:45.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916759+0000","last_change":"2024-08-15T17:53:50.910666+0000","last_active":"2024-08-15T17:53:50.916759+0000","last_peered":"2024-08-15T17:53:50.916759+0000","last_clean":"2024-08-15T17:53:50.916759+0000","last_became_active":"2024-08-15T17:53:50.910345+0000","last_became_peered":"2024-08-15T17:53:50.910345+0000","last_unstale":"2024-08-15T17:53:50.916759+0000","last_undegraded":"2024-08-15T17:53:50.916759+0000","last_fullsized":"2024-08-15T17:53:50.916759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:43:44.130985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907737+0000","last_change":"2024-08-15T17:53:49.902030+0000","last_active":"2024-08-15T17:53:50.907737+0000","last_peered":"2024-08-15T17:53:50.907737+0000","last_clean":"2024-08-15T17:53:50.907737+0000","last_became_active":"2024-08-15T17:53:49.901738+0000","last_became_peered":"2024-08-15T17:53:49.901738+0000","last_unstale":"2024-08-15T17:53:50.907737+0000","last_undegraded":"2024-08-15T17:53:50.907737+0000","last_fullsized":"2024-08-15T17:53:50.907737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:09.859088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.925197+0000","last_change":"2024-08-15T17:53:50.922614+0000","last_active":"2024-08-15T17:53:50.925197+0000","last_peered":"2024-08-15T17:53:50.925197+0000","last_clean":"2024-08-15T17:53:50.925197+0000","last_became_active":"2024-08-15T17:53:50.922233+0000","last_became_peered":"2024-08-15T17:53:50.922233+0000","last_unstale":"2024-08-15T17:53:50.925197+0000","last_undegraded":"2024-08-15T17:53:50.925197+0000","last_fullsized":"2024-08-15T17:53:50.925197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:41.928727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.891019+0000","last_change":"2024-08-15T17:53:49.902494+0000","last_active":"2024-08-15T17:53:50.891019+0000","last_peered":"2024-08-15T17:53:50.891019+0000","last_clean":"2024-08-15T17:53:50.891019+0000","last_became_active":"2024-08-15T17:53:49.902216+0000","last_became_peered":"2024-08-15T17:53:49.902216+0000","last_unstale":"2024-08-15T17:53:50.891019+0000","last_undegraded":"2024-08-15T17:53:50.891019+0000","last_fullsized":"2024-08-15T17:53:50.891019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.909269+0000","last_change":"2024-08-15T17:53:50.905961+0000","last_active":"2024-08-15T17:53:50.909269+0000","last_peered":"2024-08-15T17:53:50.909269+0000","last_clean":"2024-08-15T17:53:50.909269+0000","last_became_active":"2024-08-15T17:53:50.905662+0000","last_became_peered":"2024-08-15T17:53:50.905662+0000","last_unstale":"2024-08-15T17:53:50.909269+0000","last_undegraded":"2024-08-15T17:53:50.909269+0000","last_fullsized":"2024-08-15T17:53:50.909269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:48:41.669340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929796+0000","last_change":"2024-08-15T17:53:49.900596+0000","last_active":"2024-08-15T17:53:50.929796+0000","last_peered":"2024-08-15T17:53:50.929796+0000","last_clean":"2024-08-15T17:53:50.929796+0000","last_became_active":"2024-08-15T17:53:49.900235+0000","last_became_peered":"2024-08-15T17:53:49.900235+0000","last_unstale":"2024-08-15T17:53:50.929796+0000","last_undegraded":"2024-08-15T17:53:50.929796+0000","last_fullsized":"2024-08-15T17:53:50.929796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:29:03.575002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926118+0000","last_change":"2024-08-15T17:53:50.919099+0000","last_active":"2024-08-15T17:53:50.926118+0000","last_peered":"2024-08-15T17:53:50.926118+0000","last_clean":"2024-08-15T17:53:50.926118+0000","last_became_active":"2024-08-15T17:53:50.918636+0000","last_became_peered":"2024-08-15T17:53:50.918636+0000","last_unstale":"2024-08-15T17:53:50.926118+0000","last_undegraded":"2024-08-15T17:53:50.926118+0000","last_fullsized":"2024-08-15T17:53:50.926118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:59:38.373192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.937468+0000","last_change":"2024-08-15T17:53:49.901002+0000","last_active":"2024-08-15T17:53:50.937468+0000","last_peered":"2024-08-15T17:53:50.937468+0000","last_clean":"2024-08-15T17:53:50.937468+0000","last_became_active":"2024-08-15T17:53:49.900687+0000","last_became_peered":"2024-08-15T17:53:49.900687+0000","last_unstale":"2024-08-15T17:53:50.937468+0000","last_undegraded":"2024-08-15T17:53:50.937468+0000","last_fullsized":"2024-08-15T17:53:50.937468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:00:56.507072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916662+0000","last_change":"2024-08-15T17:53:50.915295+0000","last_active":"2024-08-15T17:53:50.916662+0000","last_peered":"2024-08-15T17:53:50.916662+0000","last_clean":"2024-08-15T17:53:50.916662+0000","last_became_active":"2024-08-15T17:53:50.914142+0000","last_became_peered":"2024-08-15T17:53:50.914142+0000","last_unstale":"2024-08-15T17:53:50.916662+0000","last_undegraded":"2024-08-15T17:53:50.916662+0000","last_fullsized":"2024-08-15T17:53:50.916662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:02:56.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928512+0000","last_change":"2024-08-15T17:53:49.909805+0000","last_active":"2024-08-15T17:53:50.928512+0000","last_peered":"2024-08-15T17:53:50.928512+0000","last_clean":"2024-08-15T17:53:50.928512+0000","last_became_active":"2024-08-15T17:53:49.909490+0000","last_became_peered":"2024-08-15T17:53:49.909490+0000","last_unstale":"2024-08-15T17:53:50.928512+0000","last_undegraded":"2024-08-15T17:53:50.928512+0000","last_fullsized":"2024-08-15T17:53:50.928512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.922626+0000","last_change":"2024-08-15T17:53:50.921696+0000","last_active":"2024-08-15T17:53:50.922626+0000","last_peered":"2024-08-15T17:53:50.922626+0000","last_clean":"2024-08-15T17:53:50.922626+0000","last_became_active":"2024-08-15T17:53:50.921385+0000","last_became_peered":"2024-08-15T17:53:50.921385+0000","last_unstale":"2024-08-15T17:53:50.922626+0000","last_undegraded":"2024-08-15T17:53:50.922626+0000","last_fullsized":"2024-08-15T17:53:50.922626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:18:16.921670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903791+0000","last_change":"2024-08-15T17:53:49.902363+0000","last_active":"2024-08-15T17:53:50.903791+0000","last_peered":"2024-08-15T17:53:50.903791+0000","last_clean":"2024-08-15T17:53:50.903791+0000","last_became_active":"2024-08-15T17:53:49.902061+0000","last_became_peered":"2024-08-15T17:53:49.902061+0000","last_unstale":"2024-08-15T17:53:50.903791+0000","last_undegraded":"2024-08-15T17:53:50.903791+0000","last_fullsized":"2024-08-15T17:53:50.903791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920873+0000","last_change":"2024-08-15T17:53:50.916048+0000","last_active":"2024-08-15T17:53:50.920873+0000","last_peered":"2024-08-15T17:53:50.920873+0000","last_clean":"2024-08-15T17:53:50.920873+0000","last_became_active":"2024-08-15T17:53:50.915821+0000","last_became_peered":"2024-08-15T17:53:50.915821+0000","last_unstale":"2024-08-15T17:53:50.920873+0000","last_undegraded":"2024-08-15T17:53:50.920873+0000","last_fullsized":"2024-08-15T17:53:50.920873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:52:59.537353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.889576+0000","last_change":"2024-08-15T17:53:49.906337+0000","last_active":"2024-08-15T17:53:50.889576+0000","last_peered":"2024-08-15T17:53:50.889576+0000","last_clean":"2024-08-15T17:53:50.889576+0000","last_became_active":"2024-08-15T17:53:49.906050+0000","last_became_peered":"2024-08-15T17:53:49.906050+0000","last_unstale":"2024-08-15T17:53:50.889576+0000","last_undegraded":"2024-08-15T17:53:50.889576+0000","last_fullsized":"2024-08-15T17:53:50.889576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913496+0000","last_change":"2024-08-15T17:53:50.912426+0000","last_active":"2024-08-15T17:53:50.913496+0000","last_peered":"2024-08-15T17:53:50.913496+0000","last_clean":"2024-08-15T17:53:50.913496+0000","last_became_active":"2024-08-15T17:53:50.912134+0000","last_became_peered":"2024-08-15T17:53:50.912134+0000","last_unstale":"2024-08-15T17:53:50.913496+0000","last_undegraded":"2024-08-15T17:53:50.913496+0000","last_fullsized":"2024-08-15T17:53:50.913496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:52:47.297392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.935231+0000","last_change":"2024-08-15T17:53:49.900275+0000","last_active":"2024-08-15T17:53:50.935231+0000","last_peered":"2024-08-15T17:53:50.935231+0000","last_clean":"2024-08-15T17:53:50.935231+0000","last_became_active":"2024-08-15T17:53:49.899966+0000","last_became_peered":"2024-08-15T17:53:49.899966+0000","last_unstale":"2024-08-15T17:53:50.935231+0000","last_undegraded":"2024-08-15T17:53:50.935231+0000","last_fullsized":"2024-08-15T17:53:50.935231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926113+0000","last_change":"2024-08-15T17:53:50.918891+0000","last_active":"2024-08-15T17:53:50.926113+0000","last_peered":"2024-08-15T17:53:50.926113+0000","last_clean":"2024-08-15T17:53:50.926113+0000","last_became_active":"2024-08-15T17:53:50.918558+0000","last_became_peered":"2024-08-15T17:53:50.918558+0000","last_unstale":"2024-08-15T17:53:50.926113+0000","last_undegraded":"2024-08-15T17:53:50.926113+0000","last_fullsized":"2024-08-15T17:53:50.926113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:41:00.113854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927838+0000","last_change":"2024-08-15T17:53:49.911008+0000","last_active":"2024-08-15T17:53:50.927838+0000","last_peered":"2024-08-15T17:53:50.927838+0000","last_clean":"2024-08-15T17:53:50.927838+0000","last_became_active":"2024-08-15T17:53:49.910689+0000","last_became_peered":"2024-08-15T17:53:49.910689+0000","last_unstale":"2024-08-15T17:53:50.927838+0000","last_undegraded":"2024-08-15T17:53:50.927838+0000","last_fullsized":"2024-08-15T17:53:50.927838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:36.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907379+0000","last_change":"2024-08-15T17:53:50.904230+0000","last_active":"2024-08-15T17:53:50.907379+0000","last_peered":"2024-08-15T17:53:50.907379+0000","last_clean":"2024-08-15T17:53:50.907379+0000","last_became_active":"2024-08-15T17:53:50.903601+0000","last_became_peered":"2024-08-15T17:53:50.903601+0000","last_unstale":"2024-08-15T17:53:50.907379+0000","last_undegraded":"2024-08-15T17:53:50.907379+0000","last_fullsized":"2024-08-15T17:53:50.907379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:52.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.927051+0000","last_change":"2024-08-15T17:53:49.912205+0000","last_active":"2024-08-15T17:53:50.927051+0000","last_peered":"2024-08-15T17:53:50.927051+0000","last_clean":"2024-08-15T17:53:50.927051+0000","last_became_active":"2024-08-15T17:53:49.911956+0000","last_became_peered":"2024-08-15T17:53:49.911956+0000","last_unstale":"2024-08-15T17:53:50.927051+0000","last_undegraded":"2024-08-15T17:53:50.927051+0000","last_fullsized":"2024-08-15T17:53:50.927051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915634+0000","last_change":"2024-08-15T17:53:50.913859+0000","last_active":"2024-08-15T17:53:50.915634+0000","last_peered":"2024-08-15T17:53:50.915634+0000","last_clean":"2024-08-15T17:53:50.915634+0000","last_became_active":"2024-08-15T17:53:50.912444+0000","last_became_peered":"2024-08-15T17:53:50.912444+0000","last_unstale":"2024-08-15T17:53:50.915634+0000","last_undegraded":"2024-08-15T17:53:50.915634+0000","last_fullsized":"2024-08-15T17:53:50.915634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928230+0000","last_change":"2024-08-15T17:53:49.907669+0000","last_active":"2024-08-15T17:53:50.928230+0000","last_peered":"2024-08-15T17:53:50.928230+0000","last_clean":"2024-08-15T17:53:50.928230+0000","last_became_active":"2024-08-15T17:53:49.907403+0000","last_became_peered":"2024-08-15T17:53:49.907403+0000","last_unstale":"2024-08-15T17:53:50.928230+0000","last_undegraded":"2024-08-15T17:53:50.928230+0000","last_fullsized":"2024-08-15T17:53:50.928230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.915176+0000","last_change":"2024-08-15T17:53:50.907476+0000","last_active":"2024-08-15T17:53:50.915176+0000","last_peered":"2024-08-15T17:53:50.915176+0000","last_clean":"2024-08-15T17:53:50.915176+0000","last_became_active":"2024-08-15T17:53:50.907146+0000","last_became_peered":"2024-08-15T17:53:50.907146+0000","last_unstale":"2024-08-15T17:53:50.915176+0000","last_undegraded":"2024-08-15T17:53:50.915176+0000","last_fullsized":"2024-08-15T17:53:50.915176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:32:00.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.906127+0000","last_change":"2024-08-15T17:53:49.910179+0000","last_active":"2024-08-15T17:53:50.906127+0000","last_peered":"2024-08-15T17:53:50.906127+0000","last_clean":"2024-08-15T17:53:50.906127+0000","last_became_active":"2024-08-15T17:53:49.909876+0000","last_became_peered":"2024-08-15T17:53:49.909876+0000","last_unstale":"2024-08-15T17:53:50.906127+0000","last_undegraded":"2024-08-15T17:53:50.906127+0000","last_fullsized":"2024-08-15T17:53:50.906127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T17:55:29.752985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920590+0000","last_change":"2024-08-15T17:53:50.911334+0000","last_active":"2024-08-15T17:53:50.920590+0000","last_peered":"2024-08-15T17:53:50.920590+0000","last_clean":"2024-08-15T17:53:50.920590+0000","last_became_active":"2024-08-15T17:53:50.911063+0000","last_became_peered":"2024-08-15T17:53:50.911063+0000","last_unstale":"2024-08-15T17:53:50.920590+0000","last_undegraded":"2024-08-15T17:53:50.920590+0000","last_fullsized":"2024-08-15T17:53:50.920590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:43:02.650253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.907635+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:53:50.907635+0000","last_peered":"2024-08-15T17:53:50.907635+0000","last_clean":"2024-08-15T17:53:50.907635+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:53:50.907635+0000","last_undegraded":"2024-08-15T17:53:50.907635+0000","last_fullsized":"2024-08-15T17:53:50.907635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901688+0000","last_change":"2024-08-15T17:53:49.903821+0000","last_active":"2024-08-15T17:53:50.901688+0000","last_peered":"2024-08-15T17:53:50.901688+0000","last_clean":"2024-08-15T17:53:50.901688+0000","last_became_active":"2024-08-15T17:53:49.903160+0000","last_became_peered":"2024-08-15T17:53:49.903160+0000","last_unstale":"2024-08-15T17:53:50.901688+0000","last_undegraded":"2024-08-15T17:53:50.901688+0000","last_fullsized":"2024-08-15T17:53:50.901688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:15.247369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914180+0000","last_change":"2024-08-15T17:53:50.905075+0000","last_active":"2024-08-15T17:53:50.914180+0000","last_peered":"2024-08-15T17:53:50.914180+0000","last_clean":"2024-08-15T17:53:50.914180+0000","last_became_active":"2024-08-15T17:53:50.904749+0000","last_became_peered":"2024-08-15T17:53:50.904749+0000","last_unstale":"2024-08-15T17:53:50.914180+0000","last_undegraded":"2024-08-15T17:53:50.914180+0000","last_fullsized":"2024-08-15T17:53:50.914180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:47:12.400881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901032+0000","last_change":"2024-08-15T17:53:49.911873+0000","last_active":"2024-08-15T17:53:50.901032+0000","last_peered":"2024-08-15T17:53:50.901032+0000","last_clean":"2024-08-15T17:53:50.901032+0000","last_became_active":"2024-08-15T17:53:49.911498+0000","last_became_peered":"2024-08-15T17:53:49.911498+0000","last_unstale":"2024-08-15T17:53:50.901032+0000","last_undegraded":"2024-08-15T17:53:50.901032+0000","last_fullsized":"2024-08-15T17:53:50.901032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:03:14.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910897+0000","last_change":"2024-08-15T17:53:50.906668+0000","last_active":"2024-08-15T17:53:50.910897+0000","last_peered":"2024-08-15T17:53:50.910897+0000","last_clean":"2024-08-15T17:53:50.910897+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.910897+0000","last_undegraded":"2024-08-15T17:53:50.910897+0000","last_fullsized":"2024-08-15T17:53:50.910897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893174+0000","last_change":"2024-08-15T17:53:49.911863+0000","last_active":"2024-08-15T17:53:50.893174+0000","last_peered":"2024-08-15T17:53:50.893174+0000","last_clean":"2024-08-15T17:53:50.893174+0000","last_became_active":"2024-08-15T17:53:49.911016+0000","last_became_peered":"2024-08-15T17:53:49.911016+0000","last_unstale":"2024-08-15T17:53:50.893174+0000","last_undegraded":"2024-08-15T17:53:50.893174+0000","last_fullsized":"2024-08-15T17:53:50.893174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:58:15.480731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.917041+0000","last_change":"2024-08-15T17:53:50.913148+0000","last_active":"2024-08-15T17:53:50.917041+0000","last_peered":"2024-08-15T17:53:50.917041+0000","last_clean":"2024-08-15T17:53:50.917041+0000","last_became_active":"2024-08-15T17:53:50.912494+0000","last_became_peered":"2024-08-15T17:53:50.912494+0000","last_unstale":"2024-08-15T17:53:50.917041+0000","last_undegraded":"2024-08-15T17:53:50.917041+0000","last_fullsized":"2024-08-15T17:53:50.917041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:31:50.664929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.903922+0000","last_change":"2024-08-15T17:53:49.902223+0000","last_active":"2024-08-15T17:53:50.903922+0000","last_peered":"2024-08-15T17:53:50.903922+0000","last_clean":"2024-08-15T17:53:50.903922+0000","last_became_active":"2024-08-15T17:53:49.901891+0000","last_became_peered":"2024-08-15T17:53:49.901891+0000","last_unstale":"2024-08-15T17:53:50.903922+0000","last_undegraded":"2024-08-15T17:53:50.903922+0000","last_fullsized":"2024-08-15T17:53:50.903922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:28:35.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.913818+0000","last_change":"2024-08-15T17:53:50.903676+0000","last_active":"2024-08-15T17:53:50.913818+0000","last_peered":"2024-08-15T17:53:50.913818+0000","last_clean":"2024-08-15T17:53:50.913818+0000","last_became_active":"2024-08-15T17:53:50.903374+0000","last_became_peered":"2024-08-15T17:53:50.903374+0000","last_unstale":"2024-08-15T17:53:50.913818+0000","last_undegraded":"2024-08-15T17:53:50.913818+0000","last_fullsized":"2024-08-15T17:53:50.913818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:21:46.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901086+0000","last_change":"2024-08-15T17:53:49.911131+0000","last_active":"2024-08-15T17:53:50.901086+0000","last_peered":"2024-08-15T17:53:50.901086+0000","last_clean":"2024-08-15T17:53:50.901086+0000","last_became_active":"2024-08-15T17:53:49.910775+0000","last_became_peered":"2024-08-15T17:53:49.910775+0000","last_unstale":"2024-08-15T17:53:50.901086+0000","last_undegraded":"2024-08-15T17:53:50.901086+0000","last_fullsized":"2024-08-15T17:53:50.901086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916594+0000","last_change":"2024-08-15T17:53:50.909590+0000","last_active":"2024-08-15T17:53:50.916594+0000","last_peered":"2024-08-15T17:53:50.916594+0000","last_clean":"2024-08-15T17:53:50.916594+0000","last_became_active":"2024-08-15T17:53:50.908589+0000","last_became_peered":"2024-08-15T17:53:50.908589+0000","last_unstale":"2024-08-15T17:53:50.916594+0000","last_undegraded":"2024-08-15T17:53:50.916594+0000","last_fullsized":"2024-08-15T17:53:50.916594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:42:37.384281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.901052+0000","last_change":"2024-08-15T17:53:49.902247+0000","last_active":"2024-08-15T17:53:50.901052+0000","last_peered":"2024-08-15T17:53:50.901052+0000","last_clean":"2024-08-15T17:53:50.901052+0000","last_became_active":"2024-08-15T17:53:49.901925+0000","last_became_peered":"2024-08-15T17:53:49.901925+0000","last_unstale":"2024-08-15T17:53:50.901052+0000","last_undegraded":"2024-08-15T17:53:50.901052+0000","last_fullsized":"2024-08-15T17:53:50.901052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:55:51.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.911493+0000","last_change":"2024-08-15T17:53:50.907678+0000","last_active":"2024-08-15T17:53:50.911493+0000","last_peered":"2024-08-15T17:53:50.911493+0000","last_clean":"2024-08-15T17:53:50.911493+0000","last_became_active":"2024-08-15T17:53:50.907388+0000","last_became_peered":"2024-08-15T17:53:50.907388+0000","last_unstale":"2024-08-15T17:53:50.911493+0000","last_undegraded":"2024-08-15T17:53:50.911493+0000","last_fullsized":"2024-08-15T17:53:50.911493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-15T17:53:52.711988+0000","last_change":"2024-08-15T17:53:49.909934+0000","last_active":"2024-08-15T17:53:52.711988+0000","last_peered":"2024-08-15T17:53:52.711988+0000","last_clean":"2024-08-15T17:53:52.711988+0000","last_became_active":"2024-08-15T17:53:49.909634+0000","last_became_peered":"2024-08-15T17:53:49.909634+0000","last_unstale":"2024-08-15T17:53:52.711988+0000","last_undegraded":"2024-08-15T17:53:52.711988+0000","last_fullsized":"2024-08-15T17:53:52.711988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916680+0000","last_change":"2024-08-15T17:53:50.906946+0000","last_active":"2024-08-15T17:53:50.916680+0000","last_peered":"2024-08-15T17:53:50.916680+0000","last_clean":"2024-08-15T17:53:50.916680+0000","last_became_active":"2024-08-15T17:53:50.906357+0000","last_became_peered":"2024-08-15T17:53:50.906357+0000","last_unstale":"2024-08-15T17:53:50.916680+0000","last_undegraded":"2024-08-15T17:53:50.916680+0000","last_fullsized":"2024-08-15T17:53:50.916680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:11:36.704644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.932574+0000","last_change":"2024-08-15T17:53:49.909938+0000","last_active":"2024-08-15T17:53:50.932574+0000","last_peered":"2024-08-15T17:53:50.932574+0000","last_clean":"2024-08-15T17:53:50.932574+0000","last_became_active":"2024-08-15T17:53:49.909683+0000","last_became_peered":"2024-08-15T17:53:49.909683+0000","last_unstale":"2024-08-15T17:53:50.932574+0000","last_undegraded":"2024-08-15T17:53:50.932574+0000","last_fullsized":"2024-08-15T17:53:50.932574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:02:40.919685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916565+0000","last_change":"2024-08-15T17:53:50.907271+0000","last_active":"2024-08-15T17:53:50.916565+0000","last_peered":"2024-08-15T17:53:50.916565+0000","last_clean":"2024-08-15T17:53:50.916565+0000","last_became_active":"2024-08-15T17:53:50.906961+0000","last_became_peered":"2024-08-15T17:53:50.906961+0000","last_unstale":"2024-08-15T17:53:50.916565+0000","last_undegraded":"2024-08-15T17:53:50.916565+0000","last_fullsized":"2024-08-15T17:53:50.916565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:07:36.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.889238+0000","last_change":"2024-08-15T17:53:49.906864+0000","last_active":"2024-08-15T17:53:50.889238+0000","last_peered":"2024-08-15T17:53:50.889238+0000","last_clean":"2024-08-15T17:53:50.889238+0000","last_became_active":"2024-08-15T17:53:49.906562+0000","last_became_peered":"2024-08-15T17:53:49.906562+0000","last_unstale":"2024-08-15T17:53:50.889238+0000","last_undegraded":"2024-08-15T17:53:50.889238+0000","last_fullsized":"2024-08-15T17:53:50.889238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:50:58.488385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920687+0000","last_change":"2024-08-15T17:53:50.914663+0000","last_active":"2024-08-15T17:53:50.920687+0000","last_peered":"2024-08-15T17:53:50.920687+0000","last_clean":"2024-08-15T17:53:50.920687+0000","last_became_active":"2024-08-15T17:53:50.914323+0000","last_became_peered":"2024-08-15T17:53:50.914323+0000","last_unstale":"2024-08-15T17:53:50.920687+0000","last_undegraded":"2024-08-15T17:53:50.920687+0000","last_fullsized":"2024-08-15T17:53:50.920687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:05:12.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.893998+0000","last_change":"2024-08-15T17:53:49.907627+0000","last_active":"2024-08-15T17:53:50.893998+0000","last_peered":"2024-08-15T17:53:50.893998+0000","last_clean":"2024-08-15T17:53:50.893998+0000","last_became_active":"2024-08-15T17:53:49.907223+0000","last_became_peered":"2024-08-15T17:53:49.907223+0000","last_unstale":"2024-08-15T17:53:50.893998+0000","last_undegraded":"2024-08-15T17:53:50.893998+0000","last_fullsized":"2024-08-15T17:53:50.893998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916724+0000","last_change":"2024-08-15T17:53:50.907755+0000","last_active":"2024-08-15T17:53:50.916724+0000","last_peered":"2024-08-15T17:53:50.916724+0000","last_clean":"2024-08-15T17:53:50.916724+0000","last_became_active":"2024-08-15T17:53:50.906949+0000","last_became_peered":"2024-08-15T17:53:50.906949+0000","last_unstale":"2024-08-15T17:53:50.916724+0000","last_undegraded":"2024-08-15T17:53:50.916724+0000","last_fullsized":"2024-08-15T17:53:50.916724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:30:16.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.905841+0000","last_change":"2024-08-15T17:53:49.911201+0000","last_active":"2024-08-15T17:53:50.905841+0000","last_peered":"2024-08-15T17:53:50.905841+0000","last_clean":"2024-08-15T17:53:50.905841+0000","last_became_active":"2024-08-15T17:53:49.910886+0000","last_became_peered":"2024-08-15T17:53:49.910886+0000","last_unstale":"2024-08-15T17:53:50.905841+0000","last_undegraded":"2024-08-15T17:53:50.905841+0000","last_fullsized":"2024-08-15T17:53:50.905841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:32:09.816301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.914395+0000","last_change":"2024-08-15T17:53:50.910580+0000","last_active":"2024-08-15T17:53:50.914395+0000","last_peered":"2024-08-15T17:53:50.914395+0000","last_clean":"2024-08-15T17:53:50.914395+0000","last_became_active":"2024-08-15T17:53:50.910272+0000","last_became_peered":"2024-08-15T17:53:50.910272+0000","last_unstale":"2024-08-15T17:53:50.914395+0000","last_undegraded":"2024-08-15T17:53:50.914395+0000","last_fullsized":"2024-08-15T17:53:50.914395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:36.898063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.930230+0000","last_change":"2024-08-15T17:53:49.903999+0000","last_active":"2024-08-15T17:53:50.930230+0000","last_peered":"2024-08-15T17:53:50.930230+0000","last_clean":"2024-08-15T17:53:50.930230+0000","last_became_active":"2024-08-15T17:53:49.903565+0000","last_became_peered":"2024-08-15T17:53:49.903565+0000","last_unstale":"2024-08-15T17:53:50.930230+0000","last_undegraded":"2024-08-15T17:53:50.930230+0000","last_fullsized":"2024-08-15T17:53:50.930230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:04:25.080927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926035+0000","last_change":"2024-08-15T17:53:50.918330+0000","last_active":"2024-08-15T17:53:50.926035+0000","last_peered":"2024-08-15T17:53:50.926035+0000","last_clean":"2024-08-15T17:53:50.926035+0000","last_became_active":"2024-08-15T17:53:50.917987+0000","last_became_peered":"2024-08-15T17:53:50.917987+0000","last_unstale":"2024-08-15T17:53:50.926035+0000","last_undegraded":"2024-08-15T17:53:50.926035+0000","last_fullsized":"2024-08-15T17:53:50.926035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:58:12.793849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.920381+0000","last_change":"2024-08-15T17:53:50.909037+0000","last_active":"2024-08-15T17:53:50.920381+0000","last_peered":"2024-08-15T17:53:50.920381+0000","last_clean":"2024-08-15T17:53:50.920381+0000","last_became_active":"2024-08-15T17:53:50.908705+0000","last_became_peered":"2024-08-15T17:53:50.908705+0000","last_unstale":"2024-08-15T17:53:50.920381+0000","last_undegraded":"2024-08-15T17:53:50.920381+0000","last_fullsized":"2024-08-15T17:53:50.920381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:50:09.164360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928245+0000","last_change":"2024-08-15T17:53:49.902233+0000","last_active":"2024-08-15T17:53:50.928245+0000","last_peered":"2024-08-15T17:53:50.928245+0000","last_clean":"2024-08-15T17:53:50.928245+0000","last_became_active":"2024-08-15T17:53:49.901894+0000","last_became_peered":"2024-08-15T17:53:49.901894+0000","last_unstale":"2024-08-15T17:53:50.928245+0000","last_undegraded":"2024-08-15T17:53:50.928245+0000","last_fullsized":"2024-08-15T17:53:50.928245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:50:43.301674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916585+0000","last_change":"2024-08-15T17:53:50.913554+0000","last_active":"2024-08-15T17:53:50.916585+0000","last_peered":"2024-08-15T17:53:50.916585+0000","last_clean":"2024-08-15T17:53:50.916585+0000","last_became_active":"2024-08-15T17:53:50.913149+0000","last_became_peered":"2024-08-15T17:53:50.913149+0000","last_unstale":"2024-08-15T17:53:50.916585+0000","last_undegraded":"2024-08-15T17:53:50.916585+0000","last_fullsized":"2024-08-15T17:53:50.916585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:45:06.673691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.928119+0000","last_change":"2024-08-15T17:53:49.902248+0000","last_active":"2024-08-15T17:53:50.928119+0000","last_peered":"2024-08-15T17:53:50.928119+0000","last_clean":"2024-08-15T17:53:50.928119+0000","last_became_active":"2024-08-15T17:53:49.901911+0000","last_became_peered":"2024-08-15T17:53:49.901911+0000","last_unstale":"2024-08-15T17:53:50.928119+0000","last_undegraded":"2024-08-15T17:53:50.928119+0000","last_fullsized":"2024-08-15T17:53:50.928119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:57:46.519979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.916752+0000","last_change":"2024-08-15T17:53:50.910641+0000","last_active":"2024-08-15T17:53:50.916752+0000","last_peered":"2024-08-15T17:53:50.916752+0000","last_clean":"2024-08-15T17:53:50.916752+0000","last_became_active":"2024-08-15T17:53:50.910342+0000","last_became_peered":"2024-08-15T17:53:50.910342+0000","last_unstale":"2024-08-15T17:53:50.916752+0000","last_undegraded":"2024-08-15T17:53:50.916752+0000","last_fullsized":"2024-08-15T17:53:50.916752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:40:55.401231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.926596+0000","last_change":"2024-08-15T17:53:49.910338+0000","last_active":"2024-08-15T17:53:50.926596+0000","last_peered":"2024-08-15T17:53:50.926596+0000","last_clean":"2024-08-15T17:53:50.926596+0000","last_became_active":"2024-08-15T17:53:49.910047+0000","last_became_peered":"2024-08-15T17:53:49.910047+0000","last_unstale":"2024-08-15T17:53:50.926596+0000","last_undegraded":"2024-08-15T17:53:50.926596+0000","last_fullsized":"2024-08-15T17:53:50.926596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:42:09.860002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.910788+0000","last_change":"2024-08-15T17:53:50.908002+0000","last_active":"2024-08-15T17:53:50.910788+0000","last_peered":"2024-08-15T17:53:50.910788+0000","last_clean":"2024-08-15T17:53:50.910788+0000","last_became_active":"2024-08-15T17:53:50.907559+0000","last_became_peered":"2024-08-15T17:53:50.907559+0000","last_unstale":"2024-08-15T17:53:50.910788+0000","last_undegraded":"2024-08-15T17:53:50.910788+0000","last_fullsized":"2024-08-15T17:53:50.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:49.870400+0000","last_clean_scrub_stamp":"2024-08-15T17:53:49.870400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:00:36.343280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-15T17:53:50.929149+0000","last_change":"2024-08-15T17:53:49.902403+0000","last_active":"2024-08-15T17:53:50.929149+0000","last_peered":"2024-08-15T17:53:50.929149+0000","last_clean":"2024-08-15T17:53:50.929149+0000","last_became_active":"2024-08-15T17:53:49.902078+0000","last_became_peered":"2024-08-15T17:53:49.902078+0000","last_unstale":"2024-08-15T17:53:50.929149+0000","last_undegraded":"2024-08-15T17:53:50.929149+0000","last_fullsized":"2024-08-15T17:53:50.929149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:48.861357+0000","last_clean_scrub_stamp":"2024-08-15T17:53:48.861357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:52:23.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":212992,"data_stored":73445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":72931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":72875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":663335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":806912,"data_stored":663313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:54:02.693 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-15T17:54:02.693 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-15T17:54:02.693 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-15T17:54:02.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-15T17:54:02.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.791+0000 7f3fc1e4f700 1 Processor -- start 2024-08-15T17:54:02.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.791+0000 7f3fc1e4f700 1 -- start start 2024-08-15T17:54:02.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fbc154900 0x7f3fbc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0cb560 0x7f3fbc160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc0b1730 con 0x7f3fbc0b12d0 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc068790 con 0x7f3fbc154900 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc1583f0 con 0x7f3fbc0cb560 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc0e4d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fbc154900 0x7f3fbc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fbbfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3fbc0b12d0 0x7f3fbc0cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46982/0 (socket says 172.21.15.33:46982) 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fbbfff700 1 -- 172.21.15.33:0/3332911141 learned_addr learned my addr 172.21.15.33:0/3332911141 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc164e700 1 --2- 172.21.15.33:0/3332911141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0cb560 0x7f3fbc160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc0e4d700 1 -- 172.21.15.33:0/3332911141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0cb560 msgr2=0x7f3fbc160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc0e4d700 1 --2- 172.21.15.33:0/3332911141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0cb560 0x7f3fbc160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/3332911141 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216341192 0 0) 0x7f3fb0001110 con 0x7f3fbc0b12d0 2024-08-15T17:54:02.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc0e4d700 1 -- 172.21.15.33:0/3332911141 >> v1:172.21.15.33:6789/0 conn(0x7f3fbc0b12d0 legacy=0x7f3fbc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc0e4d700 1 -- 172.21.15.33:0/3332911141 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0cbaa0 con 0x7f3fbc154900 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc0e4d700 1 --2- 172.21.15.33:0/3332911141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc0b0d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0098e0 tx=0x7f3fac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1ce830f53006ee server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/3332911141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac009e80 con 0x7f3fbc154900 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/3332911141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac00b860 con 0x7f3fbc154900 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/3332911141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00bbe0 con 0x7f3fbc154900 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/3332911141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 msgr2=0x7f3fbc0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/3332911141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc0b0d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0098e0 tx=0x7f3fac0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/3332911141 shutdown_connections 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/3332911141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0cb560 0x7f3fbc160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/3332911141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc0b0d90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/3332911141 >> 172.21.15.33:0/3332911141 conn(0x7f3fbc0678d0 msgr2=0x7f3fbc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/3332911141 shutdown_connections 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/3332911141 wait complete. 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 Processor -- start 2024-08-15T17:54:02.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.795+0000 7f3fc1e4f700 1 -- start start 2024-08-15T17:54:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0b12d0 0x7f3fbc0c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fbc0cb560 0x7f3fbc0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c7650 con 0x7f3fbc154900 2024-08-15T17:54:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c7880 con 0x7f3fbc0cb560 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0af5e0 con 0x7f3fbc0b12d0 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fbbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fbc0cb560 0x7f3fbc0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35582/0 (socket says 172.21.15.33:35582) 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 -- 172.21.15.33:0/544351810 learned_addr learned my addr 172.21.15.33:0/544351810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc0e4d700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0b12d0 0x7f3fbc0c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 -- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0b12d0 msgr2=0x7f3fbc0c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0b12d0 0x7f3fbc0c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 -- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fbc0cb560 msgr2=0x7f3fbc0c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fbc0cb560 0x7f3fbc0c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 -- 172.21.15.33:0/544351810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac009420 con 0x7f3fbc154900 2024-08-15T17:54:02.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fbbfff700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fbc0cb560 0x7f3fbc0c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:02.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc164e700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc150310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009fd0 tx=0x7f3fb4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400ebf0 con 0x7f3fbc154900 2024-08-15T17:54:02.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400ed50 con 0x7f3fbc154900 2024-08-15T17:54:02.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4014670 con 0x7f3fbc154900 2024-08-15T17:54:02.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0aecb0 con 0x7f3fbc154900 2024-08-15T17:54:02.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.799+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc0af270 con 0x7f3fbc154900 2024-08-15T17:54:02.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.803+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3fb40149e0 con 0x7f3fbc154900 2024-08-15T17:54:02.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.803+0000 7f3fb8ff9700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3fa8060860 0x7f3fa8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:02.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.803+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fb407d220 con 0x7f3fbc154900 2024-08-15T17:54:02.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.803+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc0643a0 con 0x7f3fbc154900 2024-08-15T17:54:02.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.803+0000 7f3fc0e4d700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3fa8060860 0x7f3fa8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:02.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.803+0000 7f3fc0e4d700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3fa8060860 0x7f3fa8062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0091e0 tx=0x7f3fac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:02.811+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3fb404d670 con 0x7f3fbc154900 2024-08-15T17:54:03.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.003+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3fbc0af720 con 0x7f3fbc154900 2024-08-15T17:54:03.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.003+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/544351810 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3fb4050c90 con 0x7f3fbc154900 2024-08-15T17:54:03.005 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:03.005 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-15T17:54:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3fa8060860 msgr2=0x7f3fa8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3fa8060860 0x7f3fa8062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0091e0 tx=0x7f3fac017000 comp rx=0 tx=0).stop 2024-08-15T17:54:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 msgr2=0x7f3fbc150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc150310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009fd0 tx=0x7f3fb4009900 comp rx=0 tx=0).stop 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 shutdown_connections 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3fa8060860 0x7f3fa8062d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fbc0cb560 0x7f3fbc0c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc154900 0x7f3fbc150310 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 --2- 172.21.15.33:0/544351810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fbc0b12d0 0x7f3fbc0c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 >> 172.21.15.33:0/544351810 conn(0x7f3fbc0678d0 msgr2=0x7f3fbc1538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 shutdown_connections 2024-08-15T17:54:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.007+0000 7f3fc1e4f700 1 -- 172.21.15.33:0/544351810 wait complete. 2024-08-15T17:54:03.025 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-15T17:54:03.025 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:03.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 Processor -- start 2024-08-15T17:54:03.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 -- start start 2024-08-15T17:54:03.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 0x7f2e240aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e2406e620 0x7f2e240ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e240ac000 con 0x7f2e240aecc0 2024-08-15T17:54:03.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e240ab3f0 con 0x7f2e2406e620 2024-08-15T17:54:03.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e291f9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240ab6d0 con 0x7f2e24158eb0 2024-08-15T17:54:03.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e237fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2e240aecc0 0x7f2e2406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46996/0 (socket says 172.21.15.33:46996) 2024-08-15T17:54:03.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e237fe700 1 -- 172.21.15.33:0/1284764081 learned_addr learned my addr 172.21.15.33:0/1284764081 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:03.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e289f8700 1 --2- 172.21.15.33:0/1284764081 >> v2:172.21.15.105:3300/0 conn(0x7f2e2406e620 0x7f2e240ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e23fff700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 0x7f2e240aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203732895 0 0) 0x7f2e240ac000 con 0x7f2e240aecc0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.131+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e04003570 con 0x7f2e240aecc0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411899746 0 0) 0x7f2e04003570 con 0x7f2e240aecc0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 msgr2=0x7f2e240aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 0x7f2e240aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 >> v2:172.21.15.105:3300/0 conn(0x7f2e2406e620 msgr2=0x7f2e240ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 --2- 172.21.15.33:0/1284764081 >> v2:172.21.15.105:3300/0 conn(0x7f2e2406e620 0x7f2e240ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e240ab9b0 con 0x7f2e240aecc0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f2e0c0017f0 con 0x7f2e240aecc0 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 --2- 172.21.15.33:0/1284764081 >> v2:172.21.15.105:3300/0 conn(0x7f2e2406e620 0x7f2e240ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:03.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 >> v1:172.21.15.33:6789/0 conn(0x7f2e240aecc0 legacy=0x7f2e2406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e04003a60 0x7f2e04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 0x7f2e04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e04004d50 0x7f2e040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240ab3f0 con 0x7f2e04004d50 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240ab6d0 con 0x7f2e04003a60 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0400ba60 con 0x7f2e24158eb0 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e04004d50 0x7f2e040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e23fff700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e04003a60 0x7f2e04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e237fe700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 0x7f2e04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 -- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 msgr2=0x7f2e04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24158eb0 0x7f2e04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 -- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e04003a60 msgr2=0x7f2e04003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:03.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e04003a60 0x7f2e04003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 -- 172.21.15.33:0/1284764081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04003570 con 0x7f2e04004d50 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e04004d50 0x7f2e040051c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e2406ea20 tx=0x7f2e1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e16edd02e5df80 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c009740 con 0x7f2e04004d50 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00e890 con 0x7f2e04004d50 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e22ffd700 1 -- 172.21.15.33:0/1284764081 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00ec30 con 0x7f2e04004d50 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e291f9700 1 -- 172.21.15.33:0/1284764081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e04004d50 msgr2=0x7f2e040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e291f9700 1 --2- 172.21.15.33:0/1284764081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e04004d50 0x7f2e040051c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e2406ea20 tx=0x7f2e1c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e289f8700 1 -- 172.21.15.33:0/1284764081 reap_dead start 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e291f9700 1 -- 172.21.15.33:0/1284764081 shutdown_connections 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e291f9700 1 -- 172.21.15.33:0/1284764081 >> 172.21.15.33:0/1284764081 conn(0x7f2e240678d0 msgr2=0x7f2e24067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e291f9700 1 -- 172.21.15.33:0/1284764081 shutdown_connections 2024-08-15T17:54:03.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.135+0000 7f2e291f9700 1 -- 172.21.15.33:0/1284764081 wait complete. 2024-08-15T17:54:03.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 Processor -- start 2024-08-15T17:54:03.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 -- start start 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24149050 0x7f2e24152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e240cae00 0x7f2e2414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 0x7f2e240c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2414f4f0 con 0x7f2e2414f080 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240c8710 con 0x7f2e240cae00 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24149420 con 0x7f2e24149050 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 0x7f2e240c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 0x7f2e240c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35606/0 (socket says 172.21.15.33:35606) 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 -- 172.21.15.33:0/3844288347 learned_addr learned my addr 172.21.15.33:0/3844288347 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e237fe700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e240cae00 0x7f2e2414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e23fff700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24149050 0x7f2e24152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 -- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24149050 msgr2=0x7f2e24152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24149050 0x7f2e24152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 -- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e240cae00 msgr2=0x7f2e2414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e240cae00 0x7f2e2414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 -- 172.21.15.33:0/3844288347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24150ad0 con 0x7f2e2414f080 2024-08-15T17:54:03.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e289f8700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 0x7f2e240c8ba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e04004730 tx=0x7f2e1c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c022070 con 0x7f2e2414f080 2024-08-15T17:54:03.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00ec10 con 0x7f2e2414f080 2024-08-15T17:54:03.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.139+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24150d70 con 0x7f2e2414f080 2024-08-15T17:54:03.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c01c6c0 con 0x7f2e2414f080 2024-08-15T17:54:03.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e24151330 con 0x7f2e2414f080 2024-08-15T17:54:03.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e241514f0 con 0x7f2e2414f080 2024-08-15T17:54:03.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2e1c01cab0 con 0x7f2e2414f080 2024-08-15T17:54:03.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e1bfff700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2e08060890 0x7f2e08062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e1c07e490 con 0x7f2e2414f080 2024-08-15T17:54:03.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.143+0000 7f2e23fff700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2e08060890 0x7f2e08062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.147+0000 7f2e23fff700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2e08060890 0x7f2e08062d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009db0 tx=0x7f2e14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.147+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2e1c04e8e0 con 0x7f2e2414f080 2024-08-15T17:54:03.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.307+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e240643a0 con 0x7f2e2414f080 2024-08-15T17:54:03.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.307+0000 7f2e1bfff700 1 -- 172.21.15.33:0/3844288347 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2e1c017090 con 0x7f2e2414f080 2024-08-15T17:54:03.310 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:03.311 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2e08060890 msgr2=0x7f2e08062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2e08060890 0x7f2e08062d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009db0 tx=0x7f2e14008040 comp rx=0 tx=0).stop 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 msgr2=0x7f2e240c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 0x7f2e240c8ba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e04004730 tx=0x7f2e1c01a000 comp rx=0 tx=0).stop 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 shutdown_connections 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2e08060890 0x7f2e08062d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e240cae00 0x7f2e2414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e2414f080 0x7f2e240c8ba0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 --2- 172.21.15.33:0/3844288347 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e24149050 0x7f2e24152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.311+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 >> 172.21.15.33:0/3844288347 conn(0x7f2e240678d0 msgr2=0x7f2e24063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.315+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 shutdown_connections 2024-08-15T17:54:03.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.315+0000 7f2e291f9700 1 -- 172.21.15.33:0/3844288347 wait complete. 2024-08-15T17:54:03.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:03.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 Processor -- start 2024-08-15T17:54:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 -- start start 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c20140910 0x7f9c200c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c200ae6f0 0x7f9c200cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200cc440 con 0x7f9c200cbab0 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200c3e30 con 0x7f9c200ae6f0 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c258c9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200c4110 con 0x7f9c20140910 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c250c8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c200ae6f0 0x7f9c200cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c1ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9c200cbab0 0x7f9c200c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47002/0 (socket says 172.21.15.33:47002) 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c1ffff700 1 -- 172.21.15.33:0/1634164421 learned_addr learned my addr 172.21.15.33:0/1634164421 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c250c8700 1 -- 172.21.15.33:0/1634164421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c20140910 msgr2=0x7f9c200c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c250c8700 1 --2- 172.21.15.33:0/1634164421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c20140910 0x7f9c200c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c250c8700 1 -- 172.21.15.33:0/1634164421 >> v1:172.21.15.33:6789/0 conn(0x7f9c200cbab0 legacy=0x7f9c200c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.439+0000 7f9c250c8700 1 -- 172.21.15.33:0/1634164421 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c200c43f0 con 0x7f9c200ae6f0 2024-08-15T17:54:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c250c8700 1 --2- 172.21.15.33:0/1634164421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c200cbf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009e60 tx=0x7f9c18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d1cded6d067485 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c1f7fe700 1 -- 172.21.15.33:0/1634164421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800e070 con 0x7f9c200ae6f0 2024-08-15T17:54:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c1f7fe700 1 -- 172.21.15.33:0/1634164421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800bc30 con 0x7f9c200ae6f0 2024-08-15T17:54:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c1f7fe700 1 -- 172.21.15.33:0/1634164421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18012430 con 0x7f9c200ae6f0 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 -- 172.21.15.33:0/1634164421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 msgr2=0x7f9c200cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 --2- 172.21.15.33:0/1634164421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c200cbf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009e60 tx=0x7f9c18009780 comp rx=0 tx=0).stop 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 -- 172.21.15.33:0/1634164421 shutdown_connections 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 --2- 172.21.15.33:0/1634164421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c200cbf00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 --2- 172.21.15.33:0/1634164421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c20140910 0x7f9c200c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 -- 172.21.15.33:0/1634164421 >> 172.21.15.33:0/1634164421 conn(0x7f9c200cdee0 msgr2=0x7f9c200ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 -- 172.21.15.33:0/1634164421 shutdown_connections 2024-08-15T17:54:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 -- 172.21.15.33:0/1634164421 wait complete. 2024-08-15T17:54:03.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 Processor -- start 2024-08-15T17:54:03.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.443+0000 7f9c258c9700 1 -- start start 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c201313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c200cbab0 0x7f9c20131be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c20140910 0x7f9c2016c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2006a1e0 con 0x7f9c200ae6f0 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c201330d0 con 0x7f9c20140910 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c20131900 con 0x7f9c200cbab0 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c201313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c201313c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35628/0 (socket says 172.21.15.33:35628) 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 -- 172.21.15.33:0/2204382805 learned_addr learned my addr 172.21.15.33:0/2204382805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c1ffff700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c200cbab0 0x7f9c20131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c250c8700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c20140910 0x7f9c2016c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 -- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c200cbab0 msgr2=0x7f9c20131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c200cbab0 0x7f9c20131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 -- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c20140910 msgr2=0x7f9c2016c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c20140910 0x7f9c2016c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 -- 172.21.15.33:0/2204382805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18009a20 con 0x7f9c200ae6f0 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c250c8700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c20140910 0x7f9c2016c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c248c7700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c201313c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b840 tx=0x7f9c140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400f510 con 0x7f9c200ae6f0 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1400f670 con 0x7f9c200ae6f0 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c201324c0 con 0x7f9c200ae6f0 2024-08-15T17:54:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400fa30 con 0x7f9c200ae6f0 2024-08-15T17:54:03.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c20132a80 con 0x7f9c200ae6f0 2024-08-15T17:54:03.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.447+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c200638f0 con 0x7f9c200ae6f0 2024-08-15T17:54:03.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.451+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c14024430 con 0x7f9c200ae6f0 2024-08-15T17:54:03.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.451+0000 7f9c1cff9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9c0c060860 0x7f9c0c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.451+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c1407d0b0 con 0x7f9c200ae6f0 2024-08-15T17:54:03.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.451+0000 7f9c1ffff700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9c0c060860 0x7f9c0c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.451+0000 7f9c1ffff700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9c0c060860 0x7f9c0c062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c200af8b0 tx=0x7f9c10007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.455+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c1404d560 con 0x7f9c200ae6f0 2024-08-15T17:54:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.611+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c2006ed00 con 0x7f9c200ae6f0 2024-08-15T17:54:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.611+0000 7f9c1cff9700 1 -- 172.21.15.33:0/2204382805 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c14050b80 con 0x7f9c200ae6f0 2024-08-15T17:54:03.613 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9c0c060860 msgr2=0x7f9c0c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9c0c060860 0x7f9c0c062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c200af8b0 tx=0x7f9c10007eb0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 msgr2=0x7f9c201313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c201313c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b840 tx=0x7f9c140091d0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 shutdown_connections 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9c0c060860 0x7f9c0c062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c20140910 0x7f9c2016c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c200cbab0 0x7f9c20131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 --2- 172.21.15.33:0/2204382805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c200ae6f0 0x7f9c201313c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 >> 172.21.15.33:0/2204382805 conn(0x7f9c200cdee0 msgr2=0x7f9c200cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 shutdown_connections 2024-08-15T17:54:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.615+0000 7f9c258c9700 1 -- 172.21.15.33:0/2204382805 wait complete. 2024-08-15T17:54:03.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:03.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 Processor -- start 2024-08-15T17:54:03.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 -- start start 2024-08-15T17:54:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ca81574f0 0x7f6ca8157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ca80b0d90 0x7f6ca80b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca806e010 con 0x7f6ca81514d0 2024-08-15T17:54:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80b1750 con 0x7f6ca81574f0 2024-08-15T17:54:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca8157fb0 con 0x7f6ca80b0d90 2024-08-15T17:54:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ca81574f0 0x7f6ca8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ca81514d0 0x7f6ca806ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47012/0 (socket says 172.21.15.33:47012) 2024-08-15T17:54:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca7fff700 1 -- 172.21.15.33:0/2108906518 learned_addr learned my addr 172.21.15.33:0/2108906518 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cac93a700 1 --2- 172.21.15.33:0/2108906518 >> v2:172.21.15.105:3300/0 conn(0x7f6ca80b0d90 0x7f6ca80b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca77fe700 1 -- 172.21.15.33:0/2108906518 >> v2:172.21.15.105:3300/0 conn(0x7f6ca80b0d90 msgr2=0x7f6ca80b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca77fe700 1 --2- 172.21.15.33:0/2108906518 >> v2:172.21.15.105:3300/0 conn(0x7f6ca80b0d90 0x7f6ca80b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca77fe700 1 -- 172.21.15.33:0/2108906518 >> v1:172.21.15.33:6789/0 conn(0x7f6ca81514d0 legacy=0x7f6ca806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca6ffd700 1 -- 172.21.15.33:0/2108906518 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375427372 0 0) 0x7f6ca806e010 con 0x7f6ca81514d0 2024-08-15T17:54:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca77fe700 1 -- 172.21.15.33:0/2108906518 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8158290 con 0x7f6ca81574f0 2024-08-15T17:54:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca77fe700 1 --2- 172.21.15.33:0/2108906518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81574f0 0x7f6ca8157970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80ae840 tx=0x7f6c900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f834b85cb9acf4e server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca6ffd700 1 -- 172.21.15.33:0/2108906518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90011630 con 0x7f6ca81574f0 2024-08-15T17:54:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca6ffd700 1 -- 172.21.15.33:0/2108906518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90011790 con 0x7f6ca81574f0 2024-08-15T17:54:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6ca6ffd700 1 -- 172.21.15.33:0/2108906518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90011b30 con 0x7f6ca81574f0 2024-08-15T17:54:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 -- 172.21.15.33:0/2108906518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81574f0 msgr2=0x7f6ca8157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.735+0000 7f6cad13b700 1 --2- 172.21.15.33:0/2108906518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81574f0 0x7f6ca8157970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80ae840 tx=0x7f6c900091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- 172.21.15.33:0/2108906518 shutdown_connections 2024-08-15T17:54:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 --2- 172.21.15.33:0/2108906518 >> v2:172.21.15.105:3300/0 conn(0x7f6ca80b0d90 0x7f6ca80b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 --2- 172.21.15.33:0/2108906518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81574f0 0x7f6ca8157970 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- 172.21.15.33:0/2108906518 >> 172.21.15.33:0/2108906518 conn(0x7f6ca80678a0 msgr2=0x7f6ca8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- 172.21.15.33:0/2108906518 shutdown_connections 2024-08-15T17:54:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- 172.21.15.33:0/2108906518 wait complete. 2024-08-15T17:54:03.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 Processor -- start 2024-08-15T17:54:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- start start 2024-08-15T17:54:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca80b0d90 0x7f6ca81518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 0x7f6ca8154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca81574f0 0x7f6ca8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8154e90 con 0x7f6ca81514d0 2024-08-15T17:54:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8151f30 con 0x7f6ca80b0d90 2024-08-15T17:54:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cad13b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8152210 con 0x7f6ca81574f0 2024-08-15T17:54:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 0x7f6ca8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 0x7f6ca8154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35648/0 (socket says 172.21.15.33:35648) 2024-08-15T17:54:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 -- 172.21.15.33:0/3224199733 learned_addr learned my addr 172.21.15.33:0/3224199733 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6cac93a700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca81574f0 0x7f6ca8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca7fff700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca80b0d90 0x7f6ca81518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 -- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca81574f0 msgr2=0x7f6ca8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca81574f0 0x7f6ca8155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 -- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca80b0d90 msgr2=0x7f6ca81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca80b0d90 0x7f6ca81518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 -- 172.21.15.33:0/3224199733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009420 con 0x7f6ca81514d0 2024-08-15T17:54:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.739+0000 7f6ca77fe700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 0x7f6ca8154950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ca806fbb0 tx=0x7f6c90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90011b10 con 0x7f6ca81514d0 2024-08-15T17:54:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900253f0 con 0x7f6ca81514d0 2024-08-15T17:54:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca81524f0 con 0x7f6ca81514d0 2024-08-15T17:54:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900257b0 con 0x7f6ca81514d0 2024-08-15T17:54:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8152ab0 con 0x7f6ca81514d0 2024-08-15T17:54:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8152ca0 con 0x7f6ca81514d0 2024-08-15T17:54:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6c90025be0 con 0x7f6ca81514d0 2024-08-15T17:54:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6c9ffff700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6c88060860 0x7f6c88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c9007e550 con 0x7f6ca81514d0 2024-08-15T17:54:03.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.743+0000 7f6ca7fff700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6c88060860 0x7f6c88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:03.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.747+0000 7f6ca7fff700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6c88060860 0x7f6c88062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c98001560 tx=0x7f6c98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:03.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.755+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6c9004e9a0 con 0x7f6ca81514d0 2024-08-15T17:54:03.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.919+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ca8064330 con 0x7f6ca81514d0 2024-08-15T17:54:03.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.919+0000 7f6c9ffff700 1 -- 172.21.15.33:0/3224199733 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c90051fc0 con 0x7f6ca81514d0 2024-08-15T17:54:03.921 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:03.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6c88060860 msgr2=0x7f6c88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6c88060860 0x7f6c88062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c98001560 tx=0x7f6c98009040 comp rx=0 tx=0).stop 2024-08-15T17:54:03.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 msgr2=0x7f6ca8154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:03.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 0x7f6ca8154950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ca806fbb0 tx=0x7f6c90017000 comp rx=0 tx=0).stop 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 shutdown_connections 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6c88060860 0x7f6c88062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca81574f0 0x7f6ca8155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca81514d0 0x7f6ca8154950 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 --2- 172.21.15.33:0/3224199733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca80b0d90 0x7f6ca81518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 >> 172.21.15.33:0/3224199733 conn(0x7f6ca80678a0 msgr2=0x7f6ca8063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 shutdown_connections 2024-08-15T17:54:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:03.923+0000 7f6cad13b700 1 -- 172.21.15.33:0/3224199733 wait complete. 2024-08-15T17:54:03.935 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:04.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.051+0000 7fd96a204700 1 Processor -- start 2024-08-15T17:54:04.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.051+0000 7fd96a204700 1 -- start start 2024-08-15T17:54:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9640cfb00 0x7fd964067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640cf670 con 0x7fd964158cc0 2024-08-15T17:54:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640cea60 con 0x7fd964067030 2024-08-15T17:54:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640ced40 con 0x7fd9640cfb00 2024-08-15T17:54:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd968a01700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9640cfb00 0x7fd964067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd969a03700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd964158cc0 0x7fd9641590d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47022/0 (socket says 172.21.15.33:47022) 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd969a03700 1 -- 172.21.15.33:0/3648472892 learned_addr learned my addr 172.21.15.33:0/3648472892 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd968a01700 1 -- 172.21.15.33:0/3648472892 >> v1:172.21.15.105:6789/0 conn(0x7fd964067030 legacy=0x7fd9640cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd968a01700 1 -- 172.21.15.33:0/3648472892 >> v1:172.21.15.33:6789/0 conn(0x7fd964158cc0 legacy=0x7fd9641590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd968a01700 1 -- 172.21.15.33:0/3648472892 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640cf020 con 0x7fd9640cfb00 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd957fff700 1 -- 172.21.15.33:0/3648472892 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565296 0 0) 0x7fd9640cf670 con 0x7fd964158cc0 2024-08-15T17:54:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd968a01700 1 --2- 172.21.15.33:0/3648472892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964067400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9580098e0 tx=0x7fd9580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a584c200c7b2065 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd957fff700 1 -- 172.21.15.33:0/3648472892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958009e80 con 0x7fd9640cfb00 2024-08-15T17:54:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd957fff700 1 -- 172.21.15.33:0/3648472892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95800b860 con 0x7fd9640cfb00 2024-08-15T17:54:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd957fff700 1 -- 172.21.15.33:0/3648472892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800bbe0 con 0x7fd9640cfb00 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- 172.21.15.33:0/3648472892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 msgr2=0x7fd964067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 --2- 172.21.15.33:0/3648472892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964067400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9580098e0 tx=0x7fd9580091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- 172.21.15.33:0/3648472892 shutdown_connections 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 --2- 172.21.15.33:0/3648472892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964067400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- 172.21.15.33:0/3648472892 >> 172.21.15.33:0/3648472892 conn(0x7fd9640d0b50 msgr2=0x7fd9640ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- 172.21.15.33:0/3648472892 shutdown_connections 2024-08-15T17:54:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.055+0000 7fd96a204700 1 -- 172.21.15.33:0/3648472892 wait complete. 2024-08-15T17:54:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 Processor -- start 2024-08-15T17:54:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 -- start start 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd964067030 0x7fd96416afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd964158cc0 0x7fd964159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96416b4e0 con 0x7fd9640cfb00 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640b2e60 con 0x7fd964158cc0 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96416ab80 con 0x7fd964067030 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35670/0 (socket says 172.21.15.33:35670) 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 -- 172.21.15.33:0/3892719343 learned_addr learned my addr 172.21.15.33:0/3892719343 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd969a03700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd964158cc0 0x7fd964159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd969202700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd964067030 0x7fd96416afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 -- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd964067030 msgr2=0x7fd96416afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd964067030 0x7fd96416afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 -- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd964158cc0 msgr2=0x7fd964159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd964158cc0 0x7fd964159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 -- 172.21.15.33:0/3892719343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958009420 con 0x7fd9640cfb00 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd969a03700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd964158cc0 0x7fd964159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd968a01700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964148ef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd964069520 tx=0x7fd958017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958011420 con 0x7fd9640cfb00 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd958011580 con 0x7fd9640cfb00 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9640b3100 con 0x7fd9640cfb00 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958011920 con 0x7fd9640cfb00 2024-08-15T17:54:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.059+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9640b36c0 con 0x7fd9640cfb00 2024-08-15T17:54:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.063+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640638f0 con 0x7fd9640cfb00 2024-08-15T17:54:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.063+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd958011c90 con 0x7fd9640cfb00 2024-08-15T17:54:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.063+0000 7fd9557fa700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd948060890 0x7fd948062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.063+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd95807e680 con 0x7fd9640cfb00 2024-08-15T17:54:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.063+0000 7fd969202700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd948060890 0x7fd948062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.063+0000 7fd969202700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd948060890 0x7fd948062d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd960003860 tx=0x7fd960009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.071+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd95804eb50 con 0x7fd9640cfb00 2024-08-15T17:54:04.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd96415cf60 con 0x7fd9640cfb00 2024-08-15T17:54:04.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd9557fa700 1 -- 172.21.15.33:0/3892719343 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd958052170 con 0x7fd9640cfb00 2024-08-15T17:54:04.238 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd948060890 msgr2=0x7fd948062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd948060890 0x7fd948062d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd960003860 tx=0x7fd960009040 comp rx=0 tx=0).stop 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 msgr2=0x7fd964148ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964148ef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd964069520 tx=0x7fd958017000 comp rx=0 tx=0).stop 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 shutdown_connections 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd948060890 0x7fd948062d40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd964158cc0 0x7fd964159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9640cfb00 0x7fd964148ef0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 --2- 172.21.15.33:0/3892719343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd964067030 0x7fd96416afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 >> 172.21.15.33:0/3892719343 conn(0x7fd9640d0b50 msgr2=0x7fd9640c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:04.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 shutdown_connections 2024-08-15T17:54:04.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.235+0000 7fd96a204700 1 -- 172.21.15.33:0/3892719343 wait complete. 2024-08-15T17:54:04.250 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 Processor -- start 2024-08-15T17:54:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 -- start start 2024-08-15T17:54:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 0x7fba9015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fba90156ec0 0x7fba900ad810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9015a920 con 0x7fba900b1c20 2024-08-15T17:54:04.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900b27a0 con 0x7fba90156af0 2024-08-15T17:54:04.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba95873700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900b0260 con 0x7fba90156ec0 2024-08-15T17:54:04.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba94871700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 0x7fba9015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba94871700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 0x7fba9015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35680/0 (socket says 172.21.15.33:35680) 2024-08-15T17:54:04.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba94871700 1 -- 172.21.15.33:0/1881679109 learned_addr learned my addr 172.21.15.33:0/1881679109 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:04.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.355+0000 7fba8ffff700 1 --2- 172.21.15.33:0/1881679109 >> v2:172.21.15.105:3300/0 conn(0x7fba90156ec0 0x7fba900ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8ffff700 1 -- 172.21.15.33:0/1881679109 >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 msgr2=0x7fba9015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8ffff700 1 --2- 172.21.15.33:0/1881679109 >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 0x7fba9015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8ffff700 1 -- 172.21.15.33:0/1881679109 >> v1:172.21.15.105:6789/0 conn(0x7fba900b1c20 legacy=0x7fba9015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8ffff700 1 -- 172.21.15.33:0/1881679109 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9015a6c0 con 0x7fba90156ec0 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba94871700 1 --2- 172.21.15.33:0/1881679109 >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 0x7fba9015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8ffff700 1 --2- 172.21.15.33:0/1881679109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900ad810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba9006f320 tx=0x7fba800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a0caac2a340242 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8f7fe700 1 -- 172.21.15.33:0/1881679109 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80011630 con 0x7fba90156ec0 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8f7fe700 1 -- 172.21.15.33:0/1881679109 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba80011790 con 0x7fba90156ec0 2024-08-15T17:54:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba8f7fe700 1 -- 172.21.15.33:0/1881679109 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80011b30 con 0x7fba90156ec0 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 -- 172.21.15.33:0/1881679109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 msgr2=0x7fba900ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 --2- 172.21.15.33:0/1881679109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900ad810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba9006f320 tx=0x7fba800091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 -- 172.21.15.33:0/1881679109 shutdown_connections 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 --2- 172.21.15.33:0/1881679109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900ad810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 --2- 172.21.15.33:0/1881679109 >> v2:172.21.15.33:3300/0 conn(0x7fba90156af0 0x7fba9015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 -- 172.21.15.33:0/1881679109 >> 172.21.15.33:0/1881679109 conn(0x7fba900ccdb0 msgr2=0x7fba900cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 -- 172.21.15.33:0/1881679109 shutdown_connections 2024-08-15T17:54:04.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.359+0000 7fba95873700 1 -- 172.21.15.33:0/1881679109 wait complete. 2024-08-15T17:54:04.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 Processor -- start 2024-08-15T17:54:04.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 -- start start 2024-08-15T17:54:04.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba900b1c20 0x7fba9014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 0x7fba900a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900a68e0 con 0x7fba90156af0 2024-08-15T17:54:04.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9016d630 con 0x7fba90156ec0 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba901695c0 con 0x7fba900b1c20 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 0x7fba900a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 0x7fba900a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35684/0 (socket says 172.21.15.33:35684) 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 -- 172.21.15.33:0/3009738332 learned_addr learned my addr 172.21.15.33:0/3009738332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95072700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba94871700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba900b1c20 0x7fba9014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 -- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba900b1c20 msgr2=0x7fba9014b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba900b1c20 0x7fba9014b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 -- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 msgr2=0x7fba900a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 -- 172.21.15.33:0/3009738332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840094f0 con 0x7fba90156af0 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95072700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8ffff700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 0x7fba900a5e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba80013000 tx=0x7fba80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80011b10 con 0x7fba90156af0 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba800233f0 con 0x7fba90156af0 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba80009420 con 0x7fba90156af0 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba800237b0 con 0x7fba90156af0 2024-08-15T17:54:04.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.363+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba90169b80 con 0x7fba90156af0 2024-08-15T17:54:04.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.367+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90169d70 con 0x7fba90156af0 2024-08-15T17:54:04.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.367+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fba800193b0 con 0x7fba90156af0 2024-08-15T17:54:04.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.367+0000 7fba8cff9700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fba7c060860 0x7fba7c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.367+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba8007e030 con 0x7fba90156af0 2024-08-15T17:54:04.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.367+0000 7fba94871700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fba7c060860 0x7fba7c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.367+0000 7fba94871700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fba7c060860 0x7fba7c062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba84006fd0 tx=0x7fba84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.375+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fba8004e500 con 0x7fba90156af0 2024-08-15T17:54:04.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.571+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba900638f0 con 0x7fba90156af0 2024-08-15T17:54:04.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.571+0000 7fba8cff9700 1 -- 172.21.15.33:0/3009738332 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fba80015090 con 0x7fba90156af0 2024-08-15T17:54:04.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:04.573 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:04.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fba7c060860 msgr2=0x7fba7c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fba7c060860 0x7fba7c062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba84006fd0 tx=0x7fba84008040 comp rx=0 tx=0).stop 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 msgr2=0x7fba900a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 0x7fba900a5e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba80013000 tx=0x7fba80017000 comp rx=0 tx=0).stop 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 shutdown_connections 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fba7c060860 0x7fba7c062d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba90156ec0 0x7fba900a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba90156af0 0x7fba900a5e60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 --2- 172.21.15.33:0/3009738332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba900b1c20 0x7fba9014b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 >> 172.21.15.33:0/3009738332 conn(0x7fba900ccdb0 msgr2=0x7fba901557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 shutdown_connections 2024-08-15T17:54:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.575+0000 7fba95873700 1 -- 172.21.15.33:0/3009738332 wait complete. 2024-08-15T17:54:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:04.587 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 Processor -- start 2024-08-15T17:54:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 -- start start 2024-08-15T17:54:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a88159ae0 0x7f1a880cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a88159eb0 0x7f1a880cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8815ac20 con 0x7f1a880aef10 2024-08-15T17:54:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a880cba20 con 0x7f1a88159ae0 2024-08-15T17:54:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a907ad700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8815a320 con 0x7f1a88159eb0 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a88159ae0 0x7f1a880cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a88159ae0 0x7f1a880cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:56112/0 (socket says 172.21.15.33:56112) 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8ed4a700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f1a880aef10 0x7f1a880af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:52426/0 (socket says 172.21.15.33:52426) 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 -- 172.21.15.33:0/165204331 learned_addr learned my addr 172.21.15.33:0/165204331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8dd48700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a88159eb0 0x7f1a880cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8d547700 1 -- 172.21.15.33:0/165204331 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124923057 0 0) 0x7f1a8815ac20 con 0x7f1a880aef10 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8d547700 1 -- 172.21.15.33:0/165204331 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a74003570 con 0x7f1a880aef10 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 -- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a88159eb0 msgr2=0x7f1a880cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 --2- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a88159eb0 0x7f1a880cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 -- 172.21.15.33:0/165204331 >> v1:172.21.15.105:6789/0 conn(0x7f1a880aef10 legacy=0x7f1a880af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 -- 172.21.15.33:0/165204331 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8815af00 con 0x7f1a88159ae0 2024-08-15T17:54:04.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8e549700 1 --2- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880cd710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009f20 tx=0x7f1a70009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba10000ff8e471f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8d547700 1 -- 172.21.15.33:0/165204331 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000e070 con 0x7f1a88159ae0 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8d547700 1 -- 172.21.15.33:0/165204331 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000b970 con 0x7f1a88159ae0 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.691+0000 7f1a8d547700 1 -- 172.21.15.33:0/165204331 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700092e0 con 0x7f1a88159ae0 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 msgr2=0x7f1a880cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 --2- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880cd710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009f20 tx=0x7f1a70009840 comp rx=0 tx=0).stop 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- 172.21.15.33:0/165204331 shutdown_connections 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 --2- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a88159eb0 0x7f1a880cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 --2- 172.21.15.33:0/165204331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880cd710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- 172.21.15.33:0/165204331 >> 172.21.15.33:0/165204331 conn(0x7f1a88066e00 msgr2=0x7f1a88067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- 172.21.15.33:0/165204331 shutdown_connections 2024-08-15T17:54:04.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- 172.21.15.33:0/165204331 wait complete. 2024-08-15T17:54:04.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 Processor -- start 2024-08-15T17:54:04.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- start start 2024-08-15T17:54:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a880aef10 0x7f1a880b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 0x7f1a880c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88150260 con 0x7f1a88159eb0 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88150b90 con 0x7f1a88159ae0 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a907ad700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880b5fe0 con 0x7f1a880aef10 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a8ed4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 0x7f1a880c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a8ed4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 0x7f1a880c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35690/0 (socket says 172.21.15.33:35690) 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a8ed4a700 1 -- 172.21.15.33:0/375715098 learned_addr learned my addr 172.21.15.33:0/375715098 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a8e549700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a880aef10 0x7f1a880b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.695+0000 7f1a8dd48700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a8ed4a700 1 -- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a880aef10 msgr2=0x7f1a880b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a8ed4a700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a880aef10 0x7f1a880b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a8ed4a700 1 -- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 msgr2=0x7f1a880b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a8ed4a700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a8ed4a700 1 -- 172.21.15.33:0/375715098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009ae0 con 0x7f1a88159eb0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a8ed4a700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 0x7f1a880c72c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c590 tx=0x7f1a80007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80005a70 con 0x7f1a88159eb0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a880b5740 con 0x7f1a88159eb0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a80005bd0 con 0x7f1a88159eb0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a880b5d00 con 0x7f1a88159eb0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800070d0 con 0x7f1a88159eb0 2024-08-15T17:54:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a880644b0 con 0x7f1a88159eb0 2024-08-15T17:54:04.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.699+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a80007480 con 0x7f1a88159eb0 2024-08-15T17:54:04.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.703+0000 7f1a867fc700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a68060860 0x7f1a68062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.703+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a8007bdd0 con 0x7f1a88159eb0 2024-08-15T17:54:04.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.703+0000 7f1a8e549700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a68060860 0x7f1a68062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:04.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.703+0000 7f1a8e549700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a68060860 0x7f1a68062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009880 tx=0x7f1a70018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:04.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.707+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a8004c2d0 con 0x7f1a88159eb0 2024-08-15T17:54:04.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.867+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a881596b0 con 0x7f1a88159eb0 2024-08-15T17:54:04.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a867fc700 1 -- 172.21.15.33:0/375715098 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f1a80017090 con 0x7f1a88159eb0 2024-08-15T17:54:04.871 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a68060860 msgr2=0x7f1a68062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a68060860 0x7f1a68062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009880 tx=0x7f1a70018000 comp rx=0 tx=0).stop 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 msgr2=0x7f1a880c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 0x7f1a880c72c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c590 tx=0x7f1a80007d40 comp rx=0 tx=0).stop 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 shutdown_connections 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a68060860 0x7f1a68062d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a88159ae0 0x7f1a880b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88159eb0 0x7f1a880c72c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 --2- 172.21.15.33:0/375715098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a880aef10 0x7f1a880b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 >> 172.21.15.33:0/375715098 conn(0x7f1a88066e00 msgr2=0x7f1a880b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 shutdown_connections 2024-08-15T17:54:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.871+0000 7f1a907ad700 1 -- 172.21.15.33:0/375715098 wait complete. 2024-08-15T17:54:04.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:04.886 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:04.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 Processor -- start 2024-08-15T17:54:04.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 -- start start 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec1538e0 0x7f26ec0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26ec153cb0 0x7f26ec06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec0b0ad0 con 0x7f26ec06f180 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec06f5c0 con 0x7f26ec153cb0 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f2708700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec15a940 con 0x7f26ec1538e0 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f0ca5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f26ec06f180 0x7f26ec159bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47036/0 (socket says 172.21.15.33:47036) 2024-08-15T17:54:04.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26f0ca5700 1 -- 172.21.15.33:0/1634659682 learned_addr learned my addr 172.21.15.33:0/1634659682 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:04.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26e3fff700 1 --2- 172.21.15.33:0/1634659682 >> v2:172.21.15.105:3300/0 conn(0x7f26ec153cb0 0x7f26ec06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.995+0000 7f26ebfff700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec1538e0 0x7f26ec0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26eb7fe700 1 -- 172.21.15.33:0/1634659682 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871361785 0 0) 0x7f26ec0b0ad0 con 0x7f26ec06f180 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26eb7fe700 1 -- 172.21.15.33:0/1634659682 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d8003570 con 0x7f26ec06f180 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26e3fff700 1 -- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec1538e0 msgr2=0x7f26ec0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26e3fff700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec1538e0 0x7f26ec0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26e3fff700 1 -- 172.21.15.33:0/1634659682 >> v1:172.21.15.33:6789/0 conn(0x7f26ec06f180 legacy=0x7f26ec159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26e3fff700 1 -- 172.21.15.33:0/1634659682 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0b01a0 con 0x7f26ec153cb0 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26ebfff700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec1538e0 0x7f26ec0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26e3fff700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec153cb0 0x7f26ec06ec40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f26d400b9a0 tx=0x7f26d40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c55eb24e82a11122 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26eb7fe700 1 -- 172.21.15.33:0/1634659682 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400c840 con 0x7f26ec153cb0 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26eb7fe700 1 -- 172.21.15.33:0/1634659682 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400c9a0 con 0x7f26ec153cb0 2024-08-15T17:54:05.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26eb7fe700 1 -- 172.21.15.33:0/1634659682 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400cd60 con 0x7f26ec153cb0 2024-08-15T17:54:05.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 -- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec153cb0 msgr2=0x7f26ec06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec153cb0 0x7f26ec06ec40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f26d400b9a0 tx=0x7f26d40090f0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 -- 172.21.15.33:0/1634659682 shutdown_connections 2024-08-15T17:54:05.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec153cb0 0x7f26ec06ec40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 --2- 172.21.15.33:0/1634659682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec1538e0 0x7f26ec0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 -- 172.21.15.33:0/1634659682 >> 172.21.15.33:0/1634659682 conn(0x7f26ec066e00 msgr2=0x7f26ec067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 -- 172.21.15.33:0/1634659682 shutdown_connections 2024-08-15T17:54:05.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 -- 172.21.15.33:0/1634659682 wait complete. 2024-08-15T17:54:05.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 Processor -- start 2024-08-15T17:54:05.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:04.999+0000 7f26f2708700 1 -- start start 2024-08-15T17:54:05.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec06f180 0x7f26ec0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec1538e0 0x7f26ec0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 0x7f26ec0c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0c9050 con 0x7f26ec153cb0 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0acc10 con 0x7f26ec1538e0 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0ac8e0 con 0x7f26ec06f180 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 0x7f26ec0c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 0x7f26ec0c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35694/0 (socket says 172.21.15.33:35694) 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 -- 172.21.15.33:0/350487853 learned_addr learned my addr 172.21.15.33:0/350487853 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26e3fff700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec1538e0 0x7f26ec0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26ebfff700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec06f180 0x7f26ec0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 -- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec06f180 msgr2=0x7f26ec0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec06f180 0x7f26ec0ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 -- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec1538e0 msgr2=0x7f26ec0c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec1538e0 0x7f26ec0c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 -- 172.21.15.33:0/350487853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc00d8d0 con 0x7f26ec153cb0 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26ebfff700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec06f180 0x7f26ec0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26e3fff700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec1538e0 0x7f26ec0c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f0ca5700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 0x7f26ec0c8b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001460 tx=0x7f26e4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400ce80 con 0x7f26ec153cb0 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d400b4e0 con 0x7f26ec153cb0 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400ab70 con 0x7f26ec153cb0 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e40070f0 con 0x7f26ec153cb0 2024-08-15T17:54:05.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec0ca790 con 0x7f26ec153cb0 2024-08-15T17:54:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.003+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec0645c0 con 0x7f26ec153cb0 2024-08-15T17:54:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.007+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f26e4007520 con 0x7f26ec153cb0 2024-08-15T17:54:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.007+0000 7f26e8ff9700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26cc060860 0x7f26cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.007+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26e407d190 con 0x7f26ec153cb0 2024-08-15T17:54:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.007+0000 7f26ebfff700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26cc060860 0x7f26cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.007+0000 7f26ebfff700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26cc060860 0x7f26cc062d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00d440 tx=0x7f26dc00f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.015+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f26e404d550 con 0x7f26ec153cb0 2024-08-15T17:54:05.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.179+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26ec15a680 con 0x7f26ec153cb0 2024-08-15T17:54:05.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26e8ff9700 1 -- 172.21.15.33:0/350487853 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26e4050b70 con 0x7f26ec153cb0 2024-08-15T17:54:05.183 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:05.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26cc060860 msgr2=0x7f26cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26cc060860 0x7f26cc062d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00d440 tx=0x7f26dc00f040 comp rx=0 tx=0).stop 2024-08-15T17:54:05.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 msgr2=0x7f26ec0c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 0x7f26ec0c8b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001460 tx=0x7f26e4001ae0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 shutdown_connections 2024-08-15T17:54:05.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26cc060860 0x7f26cc062d10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ec1538e0 0x7f26ec0c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ec153cb0 0x7f26ec0c8b10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 --2- 172.21.15.33:0/350487853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26ec06f180 0x7f26ec0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 >> 172.21.15.33:0/350487853 conn(0x7f26ec066e00 msgr2=0x7f26ec152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 shutdown_connections 2024-08-15T17:54:05.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.183+0000 7f26f2708700 1 -- 172.21.15.33:0/350487853 wait complete. 2024-08-15T17:54:05.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:05.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.307+0000 7fb683d40700 1 Processor -- start 2024-08-15T17:54:05.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.307+0000 7fb683d40700 1 -- start start 2024-08-15T17:54:05.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c142870 0x7fb67c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb67c067b40 0x7fb67c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c15cde0 con 0x7fb67c142c40 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c15d030 con 0x7fb67c067b40 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15d310 con 0x7fb67c142870 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb67c067b40 0x7fb67c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6812db700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb67c142c40 0x7fb67c067430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47038/0 (socket says 172.21.15.33:47038) 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb67c067b40 0x7fb67c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35700/0 (socket says 172.21.15.33:35700) 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6812db700 1 -- 172.21.15.33:0/4022853481 learned_addr learned my addr 172.21.15.33:0/4022853481 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb681adc700 1 --2- 172.21.15.33:0/4022853481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c142870 0x7fb67c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 -- 172.21.15.33:0/4022853481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c142870 msgr2=0x7fb67c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 --2- 172.21.15.33:0/4022853481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c142870 0x7fb67c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 -- 172.21.15.33:0/4022853481 >> v1:172.21.15.33:6789/0 conn(0x7fb67c142c40 legacy=0x7fb67c067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb680ada700 1 -- 172.21.15.33:0/4022853481 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867559287 0 0) 0x7fb67c15cde0 con 0x7fb67c142c40 2024-08-15T17:54:05.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 -- 172.21.15.33:0/4022853481 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c15d5f0 con 0x7fb67c067b40 2024-08-15T17:54:05.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb6822dd700 1 --2- 172.21.15.33:0/4022853481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c067b40 0x7fb67c15ab50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb674009e90 tx=0x7fb674009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2823e185f6f92f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb680ada700 1 -- 172.21.15.33:0/4022853481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400e070 con 0x7fb67c067b40 2024-08-15T17:54:05.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb680ada700 1 -- 172.21.15.33:0/4022853481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67400bbf0 con 0x7fb67c067b40 2024-08-15T17:54:05.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb680ada700 1 -- 172.21.15.33:0/4022853481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674012430 con 0x7fb67c067b40 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- 172.21.15.33:0/4022853481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c067b40 msgr2=0x7fb67c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 --2- 172.21.15.33:0/4022853481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c067b40 0x7fb67c15ab50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb674009e90 tx=0x7fb674009780 comp rx=0 tx=0).stop 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- 172.21.15.33:0/4022853481 shutdown_connections 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 --2- 172.21.15.33:0/4022853481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c067b40 0x7fb67c15ab50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 --2- 172.21.15.33:0/4022853481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c142870 0x7fb67c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- 172.21.15.33:0/4022853481 >> 172.21.15.33:0/4022853481 conn(0x7fb67c0687a0 msgr2=0x7fb67c06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- 172.21.15.33:0/4022853481 shutdown_connections 2024-08-15T17:54:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.311+0000 7fb683d40700 1 -- 172.21.15.33:0/4022853481 wait complete. 2024-08-15T17:54:05.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 Processor -- start 2024-08-15T17:54:05.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 -- start start 2024-08-15T17:54:05.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c067b40 0x7fb67c16c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb67c142870 0x7fb67c169560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 0x7fb67c0c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0af950 con 0x7fb67c142c40 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0aed40 con 0x7fb67c142870 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0af020 con 0x7fb67c067b40 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 0x7fb67c0c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 0x7fb67c0c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35714/0 (socket says 172.21.15.33:35714) 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 -- 172.21.15.33:0/2883549649 learned_addr learned my addr 172.21.15.33:0/2883549649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb681adc700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c067b40 0x7fb67c16c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6812db700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb67c142870 0x7fb67c169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 -- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c067b40 msgr2=0x7fb67c16c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c067b40 0x7fb67c16c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 -- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb67c142870 msgr2=0x7fb67c169560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb67c142870 0x7fb67c169560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 -- 172.21.15.33:0/2883549649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674009a20 con 0x7fb67c142c40 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6812db700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb67c142870 0x7fb67c169560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb681adc700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c067b40 0x7fb67c16c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb6822dd700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 0x7fb67c0c2470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb674013000 tx=0x7fb674019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674012e80 con 0x7fb67c142c40 2024-08-15T17:54:05.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67401b630 con 0x7fb67c142c40 2024-08-15T17:54:05.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c0af300 con 0x7fb67c142c40 2024-08-15T17:54:05.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67401b9f0 con 0x7fb67c142c40 2024-08-15T17:54:05.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.315+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c0ae8b0 con 0x7fb67c142c40 2024-08-15T17:54:05.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.319+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c0ac9d0 con 0x7fb67c142c40 2024-08-15T17:54:05.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.319+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb67401c400 con 0x7fb67c142c40 2024-08-15T17:54:05.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.319+0000 7fb66dffb700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb660060860 0x7fb660062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.319+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb67407ea20 con 0x7fb67c142c40 2024-08-15T17:54:05.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.319+0000 7fb681adc700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb660060860 0x7fb660062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.319+0000 7fb681adc700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb660060860 0x7fb660062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb670006fd0 tx=0x7fb670008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.327+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb67c0ac9d0 con 0x7fb67c142c40 2024-08-15T17:54:05.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.487+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb67c0ac9d0 con 0x7fb67c142c40 2024-08-15T17:54:05.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.487+0000 7fb66dffb700 1 -- 172.21.15.33:0/2883549649 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb67c0ac9d0 con 0x7fb67c142c40 2024-08-15T17:54:05.490 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb660060860 msgr2=0x7fb660062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb660060860 0x7fb660062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb670006fd0 tx=0x7fb670008040 comp rx=0 tx=0).stop 2024-08-15T17:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 msgr2=0x7fb67c0c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 0x7fb67c0c2470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb674013000 tx=0x7fb674019000 comp rx=0 tx=0).stop 2024-08-15T17:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 shutdown_connections 2024-08-15T17:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb660060860 0x7fb660062d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb67c142870 0x7fb67c169560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb67c142c40 0x7fb67c0c2470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 --2- 172.21.15.33:0/2883549649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb67c067b40 0x7fb67c16c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 >> 172.21.15.33:0/2883549649 conn(0x7fb67c0687a0 msgr2=0x7fb67c140ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 shutdown_connections 2024-08-15T17:54:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.491+0000 7fb683d40700 1 -- 172.21.15.33:0/2883549649 wait complete. 2024-08-15T17:54:05.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:05.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 Processor -- start 2024-08-15T17:54:05.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 -- start start 2024-08-15T17:54:05.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 0x7f3b6806e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b6815dcc0 0x7f3b6806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b680b0010 con 0x7f3b68147310 2024-08-15T17:54:05.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b680af440 con 0x7f3b6815dcc0 2024-08-15T17:54:05.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b703ca700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680af6e0 con 0x7f3b68146f40 2024-08-15T17:54:05.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6e166700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 0x7f3b6806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b6815dcc0 0x7f3b6806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6e967700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3b68147310 0x7f3b680a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:52440/0 (socket says 172.21.15.33:52440) 2024-08-15T17:54:05.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6e967700 1 -- 172.21.15.33:0/2512674258 learned_addr learned my addr 172.21.15.33:0/2512674258 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:05.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b6815dcc0 0x7f3b6806ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:56162/0 (socket says 172.21.15.33:56162) 2024-08-15T17:54:05.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6e166700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 0x7f3b6806e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:60364/0 (socket says 172.21.15.33:60364) 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d164700 1 -- 172.21.15.33:0/2512674258 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305782558 0 0) 0x7f3b680b0010 con 0x7f3b68147310 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d164700 1 -- 172.21.15.33:0/2512674258 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b54003570 con 0x7f3b68147310 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 -- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 msgr2=0x7f3b6806e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 --2- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 0x7f3b6806e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 -- 172.21.15.33:0/2512674258 >> v1:172.21.15.105:6789/0 conn(0x7f3b68147310 legacy=0x7f3b680a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 -- 172.21.15.33:0/2512674258 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b680af9c0 con 0x7f3b6815dcc0 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6e166700 1 --2- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 0x7f3b6806e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.619+0000 7f3b6d965700 1 --2- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b6815dcc0 0x7f3b6806ea80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009910 tx=0x7f3b580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef52a1cd76b2b586 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b6d164700 1 -- 172.21.15.33:0/2512674258 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58011630 con 0x7f3b6815dcc0 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b6d164700 1 -- 172.21.15.33:0/2512674258 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b58011790 con 0x7f3b6815dcc0 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b6d164700 1 -- 172.21.15.33:0/2512674258 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58011b30 con 0x7f3b6815dcc0 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 -- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b6815dcc0 msgr2=0x7f3b6806ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 --2- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b6815dcc0 0x7f3b6806ea80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009910 tx=0x7f3b580091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 -- 172.21.15.33:0/2512674258 shutdown_connections 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 --2- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b6815dcc0 0x7f3b6806ea80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 --2- 172.21.15.33:0/2512674258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b68146f40 0x7f3b6806e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 -- 172.21.15.33:0/2512674258 >> 172.21.15.33:0/2512674258 conn(0x7f3b68066e00 msgr2=0x7f3b68067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 -- 172.21.15.33:0/2512674258 shutdown_connections 2024-08-15T17:54:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 -- 172.21.15.33:0/2512674258 wait complete. 2024-08-15T17:54:05.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 Processor -- start 2024-08-15T17:54:05.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.623+0000 7f3b703ca700 1 -- start start 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 0x7f3b680c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b68147310 0x7f3b681422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b6815dcc0 0x7f3b68067800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680c96c0 con 0x7f3b68146f40 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b681427e0 con 0x7f3b68147310 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680c8ab0 con 0x7f3b6815dcc0 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 0x7f3b680c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 0x7f3b680c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35724/0 (socket says 172.21.15.33:35724) 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 -- 172.21.15.33:0/4049719643 learned_addr learned my addr 172.21.15.33:0/4049719643 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6d965700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b68147310 0x7f3b681422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e967700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b6815dcc0 0x7f3b68067800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 -- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b6815dcc0 msgr2=0x7f3b68067800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b6815dcc0 0x7f3b68067800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 -- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b68147310 msgr2=0x7f3b681422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b68147310 0x7f3b681422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 -- 172.21.15.33:0/4049719643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009420 con 0x7f3b68146f40 2024-08-15T17:54:05.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b6e166700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 0x7f3b680c84d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400ec80 tx=0x7f3b640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400c920 con 0x7f3b68146f40 2024-08-15T17:54:05.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400ca80 con 0x7f3b68146f40 2024-08-15T17:54:05.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b58009420 con 0x7f3b68146f40 2024-08-15T17:54:05.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400ce00 con 0x7f3b68146f40 2024-08-15T17:54:05.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.627+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b680c9070 con 0x7f3b68146f40 2024-08-15T17:54:05.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.631+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b680645c0 con 0x7f3b68146f40 2024-08-15T17:54:05.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.631+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3b64013680 con 0x7f3b68146f40 2024-08-15T17:54:05.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.631+0000 7f3b5e7fc700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3b4c060860 0x7f3b4c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.631+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b6407d2f0 con 0x7f3b68146f40 2024-08-15T17:54:05.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.631+0000 7f3b6d965700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3b4c060860 0x7f3b4c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.631+0000 7f3b6d965700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3b4c060860 0x7f3b4c062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b580091e0 tx=0x7f3b58017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.635+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3b6404d740 con 0x7f3b68146f40 2024-08-15T17:54:05.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.795+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b681454d0 con 0x7f3b68146f40 2024-08-15T17:54:05.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b5e7fc700 1 -- 172.21.15.33:0/4049719643 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b64050d60 con 0x7f3b68146f40 2024-08-15T17:54:05.799 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:05.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3b4c060860 msgr2=0x7f3b4c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3b4c060860 0x7f3b4c062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b580091e0 tx=0x7f3b58017000 comp rx=0 tx=0).stop 2024-08-15T17:54:05.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 msgr2=0x7f3b680c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 0x7f3b680c84d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400ec80 tx=0x7f3b640091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 shutdown_connections 2024-08-15T17:54:05.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3b4c060860 0x7f3b4c062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b68147310 0x7f3b681422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b6815dcc0 0x7f3b68067800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 --2- 172.21.15.33:0/4049719643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b68146f40 0x7f3b680c84d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 >> 172.21.15.33:0/4049719643 conn(0x7f3b68066e00 msgr2=0x7f3b681435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 shutdown_connections 2024-08-15T17:54:05.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.799+0000 7f3b703ca700 1 -- 172.21.15.33:0/4049719643 wait complete. 2024-08-15T17:54:05.814 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:05.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 Processor -- start 2024-08-15T17:54:05.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 -- start start 2024-08-15T17:54:05.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f1415a580 0x7f3f141580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3f14159b60 0x7f3f140b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f141585f0 con 0x7f3f140b2130 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1415bc00 con 0x7f3f14159b60 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f1a939700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140b2ac0 con 0x7f3f1415a580 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f18ed6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3f14159b60 0x7f3f140b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f137fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3f140b2130 0x7f3f140ada90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47046/0 (socket says 172.21.15.33:47046) 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f137fe700 1 -- 172.21.15.33:0/720555831 learned_addr learned my addr 172.21.15.33:0/720555831 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.919+0000 7f3f18ed6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3f14159b60 0x7f3f140b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35728/0 (socket says 172.21.15.33:35728) 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f13fff700 1 --2- 172.21.15.33:0/720555831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f1415a580 0x7f3f141580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f18ed6700 1 -- 172.21.15.33:0/720555831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f1415a580 msgr2=0x7f3f141580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f18ed6700 1 --2- 172.21.15.33:0/720555831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f1415a580 0x7f3f141580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f18ed6700 1 -- 172.21.15.33:0/720555831 >> v1:172.21.15.33:6789/0 conn(0x7f3f140b2130 legacy=0x7f3f140ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f18ed6700 1 -- 172.21.15.33:0/720555831 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1415aff0 con 0x7f3f14159b60 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f18ed6700 1 --2- 172.21.15.33:0/720555831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f140b2580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0098e0 tx=0x7f3f0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dacf15bf38d7e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f12ffd700 1 -- 172.21.15.33:0/720555831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c009e80 con 0x7f3f14159b60 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f12ffd700 1 -- 172.21.15.33:0/720555831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c00b860 con 0x7f3f14159b60 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f12ffd700 1 -- 172.21.15.33:0/720555831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00bbe0 con 0x7f3f14159b60 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 -- 172.21.15.33:0/720555831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 msgr2=0x7f3f140b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 --2- 172.21.15.33:0/720555831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f140b2580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0098e0 tx=0x7f3f0c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 -- 172.21.15.33:0/720555831 shutdown_connections 2024-08-15T17:54:05.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 --2- 172.21.15.33:0/720555831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f140b2580 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 --2- 172.21.15.33:0/720555831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f1415a580 0x7f3f141580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 -- 172.21.15.33:0/720555831 >> 172.21.15.33:0/720555831 conn(0x7f3f140a9db0 msgr2=0x7f3f140ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 -- 172.21.15.33:0/720555831 shutdown_connections 2024-08-15T17:54:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 -- 172.21.15.33:0/720555831 wait complete. 2024-08-15T17:54:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 Processor -- start 2024-08-15T17:54:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.923+0000 7f3f1a939700 1 -- start start 2024-08-15T17:54:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f140b2130 0x7f3f14143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f14098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f1415a580 0x7f3f140990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14169960 con 0x7f3f14159b60 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14169c40 con 0x7f3f1415a580 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14169f20 con 0x7f3f140b2130 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f14098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f14098bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35736/0 (socket says 172.21.15.33:35736) 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 -- 172.21.15.33:0/3238802807 learned_addr learned my addr 172.21.15.33:0/3238802807 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f18ed6700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f1415a580 0x7f3f140990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f13fff700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f140b2130 0x7f3f14143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 -- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f140b2130 msgr2=0x7f3f14143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f140b2130 0x7f3f14143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 -- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f1415a580 msgr2=0x7f3f140990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f1415a580 0x7f3f140990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 -- 172.21.15.33:0/3238802807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c009420 con 0x7f3f14159b60 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f13fff700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f140b2130 0x7f3f14143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f137fe700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f14098bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00cc70 tx=0x7f3efc001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00a940 con 0x7f3f14159b60 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00aac0 con 0x7f3f14159b60 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1416a200 con 0x7f3f14159b60 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00ae80 con 0x7f3f14159b60 2024-08-15T17:54:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f141440c0 con 0x7f3f14159b60 2024-08-15T17:54:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.927+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1416a700 con 0x7f3f14159b60 2024-08-15T17:54:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.931+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3efc007300 con 0x7f3f14159b60 2024-08-15T17:54:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.931+0000 7f3f0bfff700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ef4060860 0x7f3ef4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.931+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3efc07cd40 con 0x7f3f14159b60 2024-08-15T17:54:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.931+0000 7f3f13fff700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ef4060860 0x7f3ef4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.931+0000 7f3f13fff700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ef4060860 0x7f3ef4062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f04006fd0 tx=0x7f3f04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:05.939+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3efc04d210 con 0x7f3f14159b60 2024-08-15T17:54:06.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.135+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f141585f0 con 0x7f3f14159b60 2024-08-15T17:54:06.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f0bfff700 1 -- 172.21.15.33:0/3238802807 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f3f141585f0 con 0x7f3f14159b60 2024-08-15T17:54:06.140 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:06.140 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:06.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ef4060860 msgr2=0x7f3ef4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ef4060860 0x7f3ef4062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f04006fd0 tx=0x7f3f04008040 comp rx=0 tx=0).stop 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 msgr2=0x7f3f14098bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f14098bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00cc70 tx=0x7f3efc001a30 comp rx=0 tx=0).stop 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 shutdown_connections 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ef4060860 0x7f3ef4062d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f1415a580 0x7f3f140990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14159b60 0x7f3f14098bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 --2- 172.21.15.33:0/3238802807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f140b2130 0x7f3f14143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 >> 172.21.15.33:0/3238802807 conn(0x7f3f140a9db0 msgr2=0x7f3f14157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 shutdown_connections 2024-08-15T17:54:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.139+0000 7f3f1a939700 1 -- 172.21.15.33:0/3238802807 wait complete. 2024-08-15T17:54:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:06.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:06.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.263+0000 7ff077fff700 1 Processor -- start 2024-08-15T17:54:06.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.263+0000 7ff077fff700 1 -- start start 2024-08-15T17:54:06.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff078158d70 0x7ff078159140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0780a98d0 0x7ff0780aa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff0780ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780ac580 con 0x7ff0780a98d0 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780aff40 con 0x7ff078158d70 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780ab080 con 0x7ff0780abbc0 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0780a98d0 0x7ff0780aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0780a98d0 0x7ff0780aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35744/0 (socket says 172.21.15.33:35744) 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 -- 172.21.15.33:0/1410896153 learned_addr learned my addr 172.21.15.33:0/1410896153 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff0777fe700 1 --2- 172.21.15.33:0/1410896153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff0780ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff076ffd700 1 --2- 172.21.15.33:0/1410896153 >> v2:172.21.15.105:3300/0 conn(0x7ff078158d70 0x7ff078159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 -- 172.21.15.33:0/1410896153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 msgr2=0x7ff0780ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 --2- 172.21.15.33:0/1410896153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff0780ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 -- 172.21.15.33:0/1410896153 >> v2:172.21.15.105:3300/0 conn(0x7ff078158d70 msgr2=0x7ff078159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 --2- 172.21.15.33:0/1410896153 >> v2:172.21.15.105:3300/0 conn(0x7ff078158d70 0x7ff078159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 -- 172.21.15.33:0/1410896153 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780b0200 con 0x7ff0780a98d0 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff06ffff700 1 --2- 172.21.15.33:0/1410896153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780a98d0 0x7ff0780aa780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff07806d460 tx=0x7ff060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b234d06289e967f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff0767fc700 1 -- 172.21.15.33:0/1410896153 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060009e70 con 0x7ff0780a98d0 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff0767fc700 1 -- 172.21.15.33:0/1410896153 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000b860 con 0x7ff0780a98d0 2024-08-15T17:54:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff0767fc700 1 -- 172.21.15.33:0/1410896153 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000bc00 con 0x7ff0780a98d0 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- 172.21.15.33:0/1410896153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780a98d0 msgr2=0x7ff0780aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- 172.21.15.33:0/1410896153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780a98d0 0x7ff0780aa780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff07806d460 tx=0x7ff060009250 comp rx=0 tx=0).stop 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- 172.21.15.33:0/1410896153 shutdown_connections 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- 172.21.15.33:0/1410896153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff0780ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- 172.21.15.33:0/1410896153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780a98d0 0x7ff0780aa780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 --2- 172.21.15.33:0/1410896153 >> v2:172.21.15.105:3300/0 conn(0x7ff078158d70 0x7ff078159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- 172.21.15.33:0/1410896153 >> 172.21.15.33:0/1410896153 conn(0x7ff07806e010 msgr2=0x7ff0780aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- 172.21.15.33:0/1410896153 shutdown_connections 2024-08-15T17:54:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.267+0000 7ff077fff700 1 -- 172.21.15.33:0/1410896153 wait complete. 2024-08-15T17:54:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 Processor -- start 2024-08-15T17:54:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 -- start start 2024-08-15T17:54:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0780a98d0 0x7ff078144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff07815be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 0x7ff07815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff078155030 con 0x7ff078158d70 2024-08-15T17:54:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff078144d80 con 0x7ff0780a98d0 2024-08-15T17:54:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07815f7c0 con 0x7ff0780abbc0 2024-08-15T17:54:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 0x7ff07815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 0x7ff07815c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35754/0 (socket says 172.21.15.33:35754) 2024-08-15T17:54:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 -- 172.21.15.33:0/3731609255 learned_addr learned my addr 172.21.15.33:0/3731609255 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff06ffff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff07815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0780a98d0 0x7ff078144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 -- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 msgr2=0x7ff07815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff07815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 -- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0780a98d0 msgr2=0x7ff078144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0780a98d0 0x7ff078144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 -- 172.21.15.33:0/3731609255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094f0 con 0x7ff078158d70 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0780a98d0 0x7ff078144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 0x7ff07815c3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff070009e90 tx=0x7ff07000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000cbc0 con 0x7ff078158d70 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000f040 con 0x7ff078158d70 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07815ebb0 con 0x7ff078158d70 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.271+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070014480 con 0x7ff078158d70 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07815f170 con 0x7ff078158d70 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07815f930 con 0x7ff078158d70 2024-08-15T17:54:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff070014830 con 0x7ff078158d70 2024-08-15T17:54:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff06effd700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff05c060890 0x7ff05c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff07007d5a0 con 0x7ff078158d70 2024-08-15T17:54:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff05c060890 0x7ff05c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.275+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff05c060890 0x7ff05c062d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff068006fd0 tx=0x7ff068008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.283+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff070051530 con 0x7ff078158d70 2024-08-15T17:54:06.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.447+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0780711a0 con 0x7ff078158d70 2024-08-15T17:54:06.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff06effd700 1 -- 172.21.15.33:0/3731609255 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff0700510c0 con 0x7ff078158d70 2024-08-15T17:54:06.452 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:06.452 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff05c060890 msgr2=0x7ff05c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff05c060890 0x7ff05c062d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff068006fd0 tx=0x7ff068008040 comp rx=0 tx=0).stop 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 msgr2=0x7ff07815c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 0x7ff07815c3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff070009e90 tx=0x7ff07000b040 comp rx=0 tx=0).stop 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 shutdown_connections 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff05c060890 0x7ff05c062d40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078158d70 0x7ff07815c3b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0780abbc0 0x7ff07815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 --2- 172.21.15.33:0/3731609255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0780a98d0 0x7ff078144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 >> 172.21.15.33:0/3731609255 conn(0x7ff07806e010 msgr2=0x7ff0780ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 shutdown_connections 2024-08-15T17:54:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.451+0000 7ff077fff700 1 -- 172.21.15.33:0/3731609255 wait complete. 2024-08-15T17:54:06.466 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 Processor -- start 2024-08-15T17:54:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- start start 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff85c142ea0 0x7ff85c0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c141a00 con 0x7ff85c06e620 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c140b10 con 0x7ff85c0b0d20 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c140df0 con 0x7ff85c142ea0 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85affd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff85c06e620 0x7ff85c0b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47052/0 (socket says 172.21.15.33:47052) 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85affd700 1 -- 172.21.15.33:0/2586464744 learned_addr learned my addr 172.21.15.33:0/2586464744 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85bfff700 1 --2- 172.21.15.33:0/2586464744 >> v2:172.21.15.105:3300/0 conn(0x7ff85c142ea0 0x7ff85c0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694258638 0 0) 0x7ff85c141a00 con 0x7ff85c06e620 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff844003570 con 0x7ff85c06e620 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208705176 0 0) 0x7ff85c140b10 con 0x7ff85c0b0d20 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff85c141a00 con 0x7ff85c0b0d20 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85bfff700 1 -- 172.21.15.33:0/2586464744 >> v1:172.21.15.105:6789/0 conn(0x7ff85c0b0d20 legacy=0x7ff85c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2923806638 0 0) 0x7ff844003570 con 0x7ff85c06e620 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85bfff700 1 -- 172.21.15.33:0/2586464744 >> v1:172.21.15.33:6789/0 conn(0x7ff85c06e620 legacy=0x7ff85c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85bfff700 1 -- 172.21.15.33:0/2586464744 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c1410d0 con 0x7ff85c142ea0 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85bfff700 1 --2- 172.21.15.33:0/2586464744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c142ea0 0x7ff85c0b1800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098e0 tx=0x7ff8540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b5bbaa2d913d48 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0017f0 con 0x7ff85c142ea0 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff854011420 con 0x7ff85c142ea0 2024-08-15T17:54:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff85a7fc700 1 -- 172.21.15.33:0/2586464744 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8540117c0 con 0x7ff85c142ea0 2024-08-15T17:54:06.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- 172.21.15.33:0/2586464744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c142ea0 msgr2=0x7ff85c0b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 --2- 172.21.15.33:0/2586464744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c142ea0 0x7ff85c0b1800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098e0 tx=0x7ff8540091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- 172.21.15.33:0/2586464744 shutdown_connections 2024-08-15T17:54:06.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 --2- 172.21.15.33:0/2586464744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c142ea0 0x7ff85c0b1800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.579+0000 7ff860dce700 1 -- 172.21.15.33:0/2586464744 >> 172.21.15.33:0/2586464744 conn(0x7ff85c0678d0 msgr2=0x7ff85c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:06.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- 172.21.15.33:0/2586464744 shutdown_connections 2024-08-15T17:54:06.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- 172.21.15.33:0/2586464744 wait complete. 2024-08-15T17:54:06.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 Processor -- start 2024-08-15T17:54:06.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- start start 2024-08-15T17:54:06.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff85c06e620 0x7ff85c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c0b0d20 0x7ff85c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 0x7ff85c069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c172260 con 0x7ff85c142ea0 2024-08-15T17:54:06.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15be60 con 0x7ff85c0b0d20 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c1716e0 con 0x7ff85c06e620 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 0x7ff85c069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 0x7ff85c069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35770/0 (socket says 172.21.15.33:35770) 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 -- 172.21.15.33:0/275414923 learned_addr learned my addr 172.21.15.33:0/275414923 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85affd700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c0b0d20 0x7ff85c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85b7fe700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff85c06e620 0x7ff85c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 -- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff85c06e620 msgr2=0x7ff85c15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff85c06e620 0x7ff85c15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 -- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c0b0d20 msgr2=0x7ff85c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c0b0d20 0x7ff85c0caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 -- 172.21.15.33:0/275414923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff854009420 con 0x7ff85c142ea0 2024-08-15T17:54:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff85bfff700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 0x7ff85c069f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8540093f0 tx=0x7ff854016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85401cc40 con 0x7ff85c142ea0 2024-08-15T17:54:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c1719c0 con 0x7ff85c142ea0 2024-08-15T17:54:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85401cda0 con 0x7ff85c142ea0 2024-08-15T17:54:06.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85401a680 con 0x7ff85c142ea0 2024-08-15T17:54:06.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.583+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c171f80 con 0x7ff85c142ea0 2024-08-15T17:54:06.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.587+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c0afab0 con 0x7ff85c142ea0 2024-08-15T17:54:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.587+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff85401a9f0 con 0x7ff85c142ea0 2024-08-15T17:54:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.587+0000 7ff8437fe700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff848060860 0x7ff848062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.587+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff85407e6d0 con 0x7ff85c142ea0 2024-08-15T17:54:06.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.587+0000 7ff85b7fe700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff848060860 0x7ff848062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:06.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.591+0000 7ff85b7fe700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff848060860 0x7ff848062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff850007fd0 tx=0x7ff850007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:06.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.595+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff85404ea80 con 0x7ff85c142ea0 2024-08-15T17:54:06.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.795+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff85c06f5f0 con 0x7ff85c142ea0 2024-08-15T17:54:06.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.795+0000 7ff8437fe700 1 -- 172.21.15.33:0/275414923 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7ff8540520a0 con 0x7ff85c142ea0 2024-08-15T17:54:06.798 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:06.798 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:06.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff848060860 msgr2=0x7ff848062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff848060860 0x7ff848062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff850007fd0 tx=0x7ff850007d50 comp rx=0 tx=0).stop 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 msgr2=0x7ff85c069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 0x7ff85c069f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8540093f0 tx=0x7ff854016000 comp rx=0 tx=0).stop 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 shutdown_connections 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff848060860 0x7ff848062d10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85c0b0d20 0x7ff85c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff85c142ea0 0x7ff85c069f80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 --2- 172.21.15.33:0/275414923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff85c06e620 0x7ff85c15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 >> 172.21.15.33:0/275414923 conn(0x7ff85c0678d0 msgr2=0x7ff85c15fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 shutdown_connections 2024-08-15T17:54:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:06.799+0000 7ff860dce700 1 -- 172.21.15.33:0/275414923 wait complete. 2024-08-15T17:54:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:07.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-15T17:53:50.255551+0000', 'modified': '2024-08-15T17:53:52.911666+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6835/3596173362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6834', 'nonce': 3596173362}, {'type': 'v1', 'addr': '172.21.15.33:6835', 'nonce': 3596173362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-15T17:54:07.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-15T17:54:07.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-15T17:54:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.335+0000 7f613eb1c700 1 Processor -- start 2024-08-15T17:54:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.335+0000 7f613eb1c700 1 -- start start 2024-08-15T17:54:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f61380afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6138153880 0x7f61380b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61380b2990 con 0x7f61381534b0 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61380b3e80 con 0x7f6138153880 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6138159b50 con 0x7f6138159690 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6138153880 0x7f61380b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6138153880 0x7f61380b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35778/0 (socket says 172.21.15.33:35778) 2024-08-15T17:54:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 -- 172.21.15.33:0/977186998 learned_addr learned my addr 172.21.15.33:0/977186998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613d319700 1 --2- 172.21.15.33:0/977186998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f61380afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 -- 172.21.15.33:0/977186998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 msgr2=0x7f61380afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 --2- 172.21.15.33:0/977186998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f61380afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 -- 172.21.15.33:0/977186998 >> v1:172.21.15.105:6789/0 conn(0x7f61381534b0 legacy=0x7f61380b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 -- 172.21.15.33:0/977186998 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138159e30 con 0x7f6138153880 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613e31b700 1 --2- 172.21.15.33:0/977186998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6138153880 0x7f61380b02c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6130009f20 tx=0x7f6130009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c751e0388493cb server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613cb18700 1 -- 172.21.15.33:0/977186998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000e070 con 0x7f6138153880 2024-08-15T17:54:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613cb18700 1 -- 172.21.15.33:0/977186998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613000b9d0 con 0x7f6138153880 2024-08-15T17:54:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613cb18700 1 -- 172.21.15.33:0/977186998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300092e0 con 0x7f6138153880 2024-08-15T17:54:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- 172.21.15.33:0/977186998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6138153880 msgr2=0x7f61380b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 --2- 172.21.15.33:0/977186998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6138153880 0x7f61380b02c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6130009f20 tx=0x7f6130009840 comp rx=0 tx=0).stop 2024-08-15T17:54:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- 172.21.15.33:0/977186998 shutdown_connections 2024-08-15T17:54:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 --2- 172.21.15.33:0/977186998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6138153880 0x7f61380b02c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 --2- 172.21.15.33:0/977186998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f61380afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- 172.21.15.33:0/977186998 >> 172.21.15.33:0/977186998 conn(0x7f61380ca930 msgr2=0x7f61380cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- 172.21.15.33:0/977186998 shutdown_connections 2024-08-15T17:54:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.339+0000 7f613eb1c700 1 -- 172.21.15.33:0/977186998 wait complete. 2024-08-15T17:54:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.343+0000 7f613eb1c700 1 Processor -- start 2024-08-15T17:54:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.343+0000 7f613eb1c700 1 -- start start 2024-08-15T17:54:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 0x7f613814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6138153880 0x7f61380c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f6138146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613814c740 con 0x7f61381534b0 2024-08-15T17:54:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613814e8c0 con 0x7f6138153880 2024-08-15T17:54:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613814eba0 con 0x7f6138159690 2024-08-15T17:54:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 0x7f613814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 0x7f613814d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35782/0 (socket says 172.21.15.33:35782) 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 -- 172.21.15.33:0/3630451423 learned_addr learned my addr 172.21.15.33:0/3630451423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613e31b700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f6138146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613d319700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6138153880 0x7f61380c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 -- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 msgr2=0x7f6138146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f6138146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 -- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6138153880 msgr2=0x7f61380c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6138153880 0x7f61380c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 -- 172.21.15.33:0/3630451423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009ae0 con 0x7f61381534b0 2024-08-15T17:54:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613e31b700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f6138146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613db1a700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 0x7f613814d2d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f612800c590 tx=0x7f612800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f612dffb700 1 -- 172.21.15.33:0/3630451423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128011590 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f612dffb700 1 -- 172.21.15.33:0/3630451423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61280116f0 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613814ee80 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f612dffb700 1 -- 172.21.15.33:0/3630451423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128011ab0 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613814f440 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.347+0000 7f612dffb700 1 -- 172.21.15.33:0/3630451423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f612801b3b0 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f612dffb700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f611c060860 0x7f611c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f612dffb700 1 -- 172.21.15.33:0/3630451423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f612807c120 con 0x7f61381534b0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613d319700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f611c060860 0x7f611c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613d319700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f611c060860 0x7f611c062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61380c43d0 tx=0x7f6134008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 Processor -- start 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 -- start start 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 0x25a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x25a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x23b9790 0x25a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x251aba0 con 0x236eae0 2024-08-15T17:54:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2516b40 con 0x23b9790 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x24dc0a0 con 0x236e710 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613db1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 0x25a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613db1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 0x25a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35792/0 (socket says 172.21.15.33:35792) 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613db1a700 1 -- 172.21.15.33:0/3585647399 learned_addr learned my addr 172.21.15.33:0/3585647399 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613d319700 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x25a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.351+0000 7f613e31b700 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x23b9790 0x25a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613db1a700 1 -- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 msgr2=0x25a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613db1a700 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x25a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613db1a700 1 -- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x23b9790 msgr2=0x25a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613db1a700 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x23b9790 0x25a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613db1a700 1 -- 172.21.15.33:0/3585647399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23ba9e0 con 0x236eae0 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613e31b700 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x23b9790 0x25a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f613db1a700 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 0x25a21d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f612800f040 tx=0x7f612807a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dee3d97707769d server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f6122ffd700 1 -- 172.21.15.33:0/3585647399 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612804c570 con 0x236eae0 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f6122ffd700 1 -- 172.21.15.33:0/3585647399 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61280534c0 con 0x236eae0 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f6122ffd700 1 -- 172.21.15.33:0/3585647399 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128057210 con 0x236eae0 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 -- 172.21.15.33:0/3585647399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 msgr2=0x25a21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 0x25a21d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f612800f040 tx=0x7f612807a5a0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 -- 172.21.15.33:0/3585647399 shutdown_connections 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x23b9790 0x25a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x25a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 --2- 172.21.15.33:0/3585647399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x236eae0 0x25a21d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 -- 172.21.15.33:0/3585647399 >> 172.21.15.33:0/3585647399 conn(0x236eeb0 msgr2=0x25a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 -- 172.21.15.33:0/3585647399 shutdown_connections 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 -- 172.21.15.33:0/3585647399 wait complete. 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 -- start start 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.355+0000 7f614202d740 1 Processor -- start 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x25efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x25effe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x24dbd40 con 0x23b9790 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x24b4970 con 0x236e710 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x24c1ec0 con 0x236eae0 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 10 client.0 _ll_register_callbacks cb 0x24b8f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-15T17:54:07.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35796/0 (socket says 172.21.15.33:35796) 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 -- 172.21.15.33:0/331432502 learned_addr learned my addr 172.21.15.33:0/331432502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613db1a700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x25efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613d319700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x25effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 -- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 msgr2=0x25effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x25effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 -- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 msgr2=0x25efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x25efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 -- 172.21.15.33:0/331432502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613814f440 con 0x23b9790 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613e31b700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25a9fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6130012aa0 tx=0x7f6130018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec804e24053bf63 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 1 -- 172.21.15.33:0/331432502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300032f0 con 0x23b9790 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 1 -- 172.21.15.33:0/331432502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6130012d30 con 0x23b9790 2024-08-15T17:54:07.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x237c260 con 0x23b9790 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 1 -- 172.21.15.33:0/331432502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61300092e0 con 0x23b9790 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 10 client.4686 fetch_fsmap learned FSMap version 6 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x24e4370 con 0x23b9790 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 1 -- 172.21.15.33:0/331432502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x237c260 con 0x23b9790 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 1 -- 172.21.15.33:0/331432502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f613000b050 con 0x23b9790 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 10 client.4686 fetch_fsmap finished waiting for FSMap version 6 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 20 client.4686 populate_metadata read hostname 'smithi033' 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25f8c30 0x25fb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 4 client.4686 mds_command: new command op to 4287 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 --> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23c64e0 con 0x25f8c30 2024-08-15T17:54:07.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613db1a700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25f8c30 0x25fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f613db1a700 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25f8c30 0x25fb010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84646079a26462f7 server_cookie=7a71d436a48142be in_seq=0 out_seq=0 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.359+0000 7f6117fff700 10 client.4686 ms_handle_connect on v2:172.21.15.33:6834/3596173362 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f6117fff700 1 -- 172.21.15.33:0/331432502 <== mds.0 v2:172.21.15.33:6834/3596173362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x23c64e0 con 0x25f8c30 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f6117fff700 10 client.4686 handle_command_reply: tid=0 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 client.4686 shutdown 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 msgr2=0x25a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25a9fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6130012aa0 tx=0x7f6130018000 comp rx=0 tx=0).stop 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 shutdown_connections 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25f8c30 0x25fb010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25a9fd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x25effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f6117fff700 0 client.4686 ms_handle_reset on v2:172.21.15.33:6834/3596173362 2024-08-15T17:54:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 --2- 172.21.15.33:0/331432502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x25efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 >> 172.21.15.33:0/331432502 conn(0x236eeb0 msgr2=0x25a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 shutdown_connections 2024-08-15T17:54:07.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 1 -- 172.21.15.33:0/331432502 wait complete. 2024-08-15T17:54:07.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.363+0000 7f614202d740 20 client.4686 trim_cache size 0 max 16384 2024-08-15T17:54:07.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.379+0000 7f614202d740 1 Processor -- start 2024-08-15T17:54:07.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.379+0000 7f614202d740 1 -- start start 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x2643920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x2643e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x26443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x2519200 con 0x23b9790 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x254cbb0 con 0x236e710 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x251cda0 con 0x236eae0 2024-08-15T17:54:07.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x26443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x26443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35804/0 (socket says 172.21.15.33:35804) 2024-08-15T17:54:07.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613d319700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x2643e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 -- 172.21.15.33:0/414034908 learned_addr learned my addr 172.21.15.33:0/414034908 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613db1a700 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x2643920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 -- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 msgr2=0x2643e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x2643e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 -- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 msgr2=0x2643920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x2643920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 -- 172.21.15.33:0/414034908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24cad80 con 0x23b9790 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f613e31b700 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x26443a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6130009560 tx=0x7f6130021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42973b62a3550c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f61237fe700 1 -- 172.21.15.33:0/414034908 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130038070 con 0x23b9790 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f61237fe700 1 -- 172.21.15.33:0/414034908 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61300032f0 con 0x23b9790 2024-08-15T17:54:07.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f61237fe700 1 -- 172.21.15.33:0/414034908 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613001f490 con 0x23b9790 2024-08-15T17:54:07.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- 172.21.15.33:0/414034908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 msgr2=0x26443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x26443a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6130009560 tx=0x7f6130021070 comp rx=0 tx=0).stop 2024-08-15T17:54:07.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- 172.21.15.33:0/414034908 shutdown_connections 2024-08-15T17:54:07.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x26443a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236eae0 0x2643e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 --2- 172.21.15.33:0/414034908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236e710 0x2643920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- 172.21.15.33:0/414034908 >> 172.21.15.33:0/414034908 conn(0x236eeb0 msgr2=0x25a8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- 172.21.15.33:0/414034908 shutdown_connections 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.383+0000 7f614202d740 1 -- 172.21.15.33:0/414034908 wait complete. 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 -- start start 2024-08-15T17:54:07.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 Processor -- start 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x26474e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236eae0 0x2647a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x2512650 con 0x23b9790 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x251a2f0 con 0x236eae0 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x23eb650 con 0x236e710 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f614202d740 10 client.0 _ll_register_callbacks cb 0x233a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-15T17:54:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f613e31b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f613e31b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35820/0 (socket says 172.21.15.33:35820) 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f613e31b700 1 -- 172.21.15.33:0/652245799 learned_addr learned my addr 172.21.15.33:0/652245799 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f613db1a700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x26474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.387+0000 7f613d319700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236eae0 0x2647a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613e31b700 1 -- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 msgr2=0x26474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613e31b700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x26474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613e31b700 1 -- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236eae0 msgr2=0x2647a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613e31b700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236eae0 0x2647a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613e31b700 1 -- 172.21.15.33:0/652245799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x24e4370 con 0x23b9790 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613e31b700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25fb270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f613000b610 tx=0x7f6130038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74a5eb289f886e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 1 -- 172.21.15.33:0/652245799 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000bd50 con 0x23b9790 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 1 -- 172.21.15.33:0/652245799 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6130029ae0 con 0x23b9790 2024-08-15T17:54:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23eb260 con 0x23b9790 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 1 -- 172.21.15.33:0/652245799 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6130029eb0 con 0x23b9790 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 10 client.4692 fetch_fsmap learned FSMap version 6 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x24bf130 con 0x23b9790 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 1 -- 172.21.15.33:0/652245799 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23eb260 con 0x23b9790 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 1 -- 172.21.15.33:0/652245799 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f613004d050 con 0x23b9790 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 10 client.4692 fetch_fsmap finished waiting for FSMap version 6 2024-08-15T17:54:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 10 client.4692 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 20 client.4692 populate_metadata read hostname 'smithi033' 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25fbc30 0x25fc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 4 client.4692 mds_command: new command op to 4287 tid=0[{"prefix": "status"}] 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 --> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x24dfe90 con 0x25fbc30 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613db1a700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25fbc30 0x25fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 10 client.4692 ms_handle_connect on v2:172.21.15.33:6834/3596173362 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f613db1a700 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25fbc30 0x25fc000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2922bfc8ac330c7 server_cookie=a6b319fa56132872 in_seq=0 out_seq=0 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 1 -- 172.21.15.33:0/652245799 <== mds.0 v2:172.21.15.33:6834/3596173362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x24dfe90 con 0x25fbc30 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f6117fff700 10 client.4692 handle_command_reply: tid=0 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 client.4692 shutdown 2024-08-15T17:54:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 msgr2=0x25fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25fb270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f613000b610 tx=0x7f6130038000 comp rx=0 tx=0).stop 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 shutdown_connections 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:6834/3596173362,v1:172.21.15.33:6835/3596173362] conn(0x25fbc30 0x25fc000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x236eae0 0x2647a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x23b9790 0x25fb270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 --2- 172.21.15.33:0/652245799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x236e710 0x26474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.391+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 >> 172.21.15.33:0/652245799 conn(0x236eeb0 msgr2=0x25ee570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f6117fff700 0 client.4692 ms_handle_reset on v2:172.21.15.33:6834/3596173362 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 shutdown_connections 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f614202d740 1 -- 172.21.15.33:0/652245799 wait complete. 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f614202d740 20 client.4692 trim_cache size 0 max 16384 2024-08-15T17:54:07.397 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "55bddac8-0f58-4a43-a3ea-a8daa20f3e0c", 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4287, 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 16.488519999000001, 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 6, 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 21, 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 21, 2024-08-15T17:54:07.398 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 23.856127813000001 2024-08-15T17:54:07.399 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:54:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f611c060860 msgr2=0x7f611c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f611c060860 0x7f611c062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61380c43d0 tx=0x7f6134008040 comp rx=0 tx=0).stop 2024-08-15T17:54:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 msgr2=0x7f613814d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 0x7f613814d2d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f612800c590 tx=0x7f612800c950 comp rx=0 tx=0).stop 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 shutdown_connections 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f611c060860 0x7f611c062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6138153880 0x7f61380c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6138159690 0x7f6138146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 --2- 172.21.15.33:0/3630451423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61381534b0 0x7f613814d2d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 >> 172.21.15.33:0/3630451423 conn(0x7f61380ca930 msgr2=0x7f613814a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 shutdown_connections 2024-08-15T17:54:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.395+0000 7f613eb1c700 1 -- 172.21.15.33:0/3630451423 wait complete. 2024-08-15T17:54:07.412 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-15T17:54:07.437 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-15T17:54:07.438 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-15T17:54:07.438 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-15T17:54:07.438 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-15T17:54:07.438 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-15T17:54:07.438 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-15T17:54:07.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.439 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-15T17:54:07.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.447 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-08-15T17:54:07.469 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-08-15T17:54:07.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:54:07.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.470 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-08-15T17:54:07.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.479 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-08-15T17:54:07.496 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-08-15T17:54:07.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:54:07.498 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-15T17:54:07.498 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-15T17:54:07.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.631+0000 7f65f055c700 1 Processor -- start 2024-08-15T17:54:07.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.631+0000 7f65f055c700 1 -- start start 2024-08-15T17:54:07.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f65e80688d0 0x7f65e8068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e80c7750 con 0x7f65e80cc160 2024-08-15T17:54:07.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e80cb220 con 0x7f65e80688d0 2024-08-15T17:54:07.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80c6e20 con 0x7f65e806a470 2024-08-15T17:54:07.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65edaf7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f65e80cc160 0x7f65e80caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47058/0 (socket says 172.21.15.33:47058) 2024-08-15T17:54:07.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65edaf7700 1 -- 172.21.15.33:0/3634827671 learned_addr learned my addr 172.21.15.33:0/3634827671 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:07.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65ee2f8700 1 --2- 172.21.15.33:0/3634827671 >> v2:172.21.15.105:3300/0 conn(0x7f65e80688d0 0x7f65e8068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65eeaf9700 1 --2- 172.21.15.33:0/3634827671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65ed2f6700 1 -- 172.21.15.33:0/3634827671 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714272222 0 0) 0x7f65e80c7750 con 0x7f65e80cc160 2024-08-15T17:54:07.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65ed2f6700 1 -- 172.21.15.33:0/3634827671 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d4003570 con 0x7f65e80cc160 2024-08-15T17:54:07.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65eeaf9700 1 -- 172.21.15.33:0/3634827671 >> v2:172.21.15.105:3300/0 conn(0x7f65e80688d0 msgr2=0x7f65e8068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65eeaf9700 1 --2- 172.21.15.33:0/3634827671 >> v2:172.21.15.105:3300/0 conn(0x7f65e80688d0 0x7f65e8068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65eeaf9700 1 -- 172.21.15.33:0/3634827671 >> v1:172.21.15.33:6789/0 conn(0x7f65e80cc160 legacy=0x7f65e80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65eeaf9700 1 -- 172.21.15.33:0/3634827671 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e80c7100 con 0x7f65e806a470 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65eeaf9700 1 --2- 172.21.15.33:0/3634827671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e806a8b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009e60 tx=0x7f65e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2c6861fc407e9d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65ed2f6700 1 -- 172.21.15.33:0/3634827671 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000e070 con 0x7f65e806a470 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65ed2f6700 1 -- 172.21.15.33:0/3634827671 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e000bab0 con 0x7f65e806a470 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65ed2f6700 1 -- 172.21.15.33:0/3634827671 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000be70 con 0x7f65e806a470 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- 172.21.15.33:0/3634827671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 msgr2=0x7f65e806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 --2- 172.21.15.33:0/3634827671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e806a8b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009e60 tx=0x7f65e0009780 comp rx=0 tx=0).stop 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- 172.21.15.33:0/3634827671 shutdown_connections 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 --2- 172.21.15.33:0/3634827671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e806a8b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 --2- 172.21.15.33:0/3634827671 >> v2:172.21.15.105:3300/0 conn(0x7f65e80688d0 0x7f65e8068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- 172.21.15.33:0/3634827671 >> 172.21.15.33:0/3634827671 conn(0x7f65e80c9c20 msgr2=0x7f65e806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- 172.21.15.33:0/3634827671 shutdown_connections 2024-08-15T17:54:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.635+0000 7f65f055c700 1 -- 172.21.15.33:0/3634827671 wait complete. 2024-08-15T17:54:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 Processor -- start 2024-08-15T17:54:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 -- start start 2024-08-15T17:54:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65e80688d0 0x7f65e80c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e80c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 0x7f65e80c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80c6a70 con 0x7f65e80cc160 2024-08-15T17:54:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80c5ef0 con 0x7f65e80688d0 2024-08-15T17:54:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80c61d0 con 0x7f65e806a470 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 0x7f65e80c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 0x7f65e80c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35834/0 (socket says 172.21.15.33:35834) 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 -- 172.21.15.33:0/2534331313 learned_addr learned my addr 172.21.15.33:0/2534331313 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65edaf7700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e80c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65ee2f8700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65e80688d0 0x7f65e80c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 -- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 msgr2=0x7f65e80c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e80c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 -- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65e80688d0 msgr2=0x7f65e80c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65e80688d0 0x7f65e80c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 -- 172.21.15.33:0/2534331313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009a20 con 0x7f65e80cc160 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65eeaf9700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 0x7f65e80c3c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65e80c6f60 tx=0x7f65e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0022070 con 0x7f65e80cc160 2024-08-15T17:54:07.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0012d40 con 0x7f65e80cc160 2024-08-15T17:54:07.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e80c64b0 con 0x7f65e80cc160 2024-08-15T17:54:07.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e001b750 con 0x7f65e80cc160 2024-08-15T17:54:07.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.639+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e80c5b40 con 0x7f65e80cc160 2024-08-15T17:54:07.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.643+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e80645c0 con 0x7f65e80cc160 2024-08-15T17:54:07.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.643+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f65e0003040 con 0x7f65e80cc160 2024-08-15T17:54:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.643+0000 7f65de7fc700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f65cc060860 0x7f65cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.643+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65e007fff0 con 0x7f65e80cc160 2024-08-15T17:54:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.643+0000 7f65ee2f8700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f65cc060860 0x7f65cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.643+0000 7f65ee2f8700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f65cc060860 0x7f65cc062d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f65e400ae30 tx=0x7f65e400a330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:07.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.651+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f65e00504f0 con 0x7f65e80cc160 2024-08-15T17:54:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.851+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65e80ca480 con 0x7f65e80cc160 2024-08-15T17:54:07.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.851+0000 7f65de7fc700 1 -- 172.21.15.33:0/2534331313 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f65e0053b10 con 0x7f65e80cc160 2024-08-15T17:54:07.854 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-15T17:54:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f65cc060860 msgr2=0x7f65cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f65cc060860 0x7f65cc062d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f65e400ae30 tx=0x7f65e400a330 comp rx=0 tx=0).stop 2024-08-15T17:54:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 msgr2=0x7f65e80c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 0x7f65e80c3c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65e80c6f60 tx=0x7f65e0019000 comp rx=0 tx=0).stop 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 shutdown_connections 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f65cc060860 0x7f65cc062d10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65e80cc160 0x7f65e80c3c30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65e806a470 0x7f65e80c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 --2- 172.21.15.33:0/2534331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65e80688d0 0x7f65e80c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 >> 172.21.15.33:0/2534331313 conn(0x7f65e80c9c20 msgr2=0x7f65e80cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 shutdown_connections 2024-08-15T17:54:07.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:07.855+0000 7f65f055c700 1 -- 172.21.15.33:0/2534331313 wait complete. 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-15T17:54:07.868 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-15T17:54:07.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.869 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-08-15T17:54:07.876 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:07.876 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:07.876 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:07.876 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:07.876 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:07.876 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42606sec preferred_lft 42606sec 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:07.877 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:07.878 INFO:teuthology.orchestra.run.smithi033.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-15T17:54:07.878 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 02:42:8e:74:25:0d brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:07.878 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-15T17:54:07.878 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:07.878 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-15T17:54:07.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-15T17:54:07.879 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:07.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.921 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-15T17:54:07.934 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-08-15T17:54:07.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.934 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-08-15T17:54:07.960 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-08-15T17:54:07.961 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-15T17:54:07.961 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-15T17:54:07.961 INFO:teuthology.orchestra.run.smithi033.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-15T17:54:07.961 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-15T17:54:07.961 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-15T17:54:07.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:07.962 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:07.962 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:07.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-15T17:54:07.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-15T17:54:07.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-15T17:54:07.962 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:08.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:08.042 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-15T17:54:08.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:08.048 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-08-15T17:54:08.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:08.055 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:08.055 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:08.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-15T17:54:08.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-15T17:54:08.055 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:08.131 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-15T17:54:08.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-15T17:54:08.132 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:08.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:08.205 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:08.206 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:08.206 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-08-15T17:54:08.206 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-08-15T17:54:08.206 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:08.237 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-15T17:54:08.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:08.237 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:08.243 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-15T17:54:08.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:08.244 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:08.249 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:08.308 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:08.308 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:08.323 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:08.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:08.324 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:08.332 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-15T17:54:08.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-15T17:54:08.334 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:08.351 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:08.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:08.411 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:08.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:08.412 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:08.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:2024-08-15T17:54:08.419+0000 7eff1b79b380 -1 init, newargv = 0x555796ff1ac0 newargc=15 2024-08-15T17:54:08.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[31310]: starting ceph client 2024-08-15T17:54:08.427 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[31310]: starting fuse 2024-08-15T17:54:09.518 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:09.535 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:09.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:09.594 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:09.595 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:09.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:09.596 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:09.603 INFO:teuthology.orchestra.run.smithi033.stdout:52 2024-08-15T17:54:09.603 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-15T17:54:09.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-15T17:54:09.603 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-08-15T17:54:09.603 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-08-15T17:54:09.604 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.0")) 2024-08-15T17:54:09.605 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-08-15T17:54:09.687 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.0.31310.asok 2024-08-15T17:54:09.870 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31310.asok 2024-08-15T17:54:09.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:09.870 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31310.asok status 2024-08-15T17:54:09.963 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:54:09.963 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-08-15T17:54:09.963 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "2c991c196a651f8ef0f36c7763ec87a241b25549", 2024-08-15T17:54:09.963 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 17.2.7-1375-g2c991c19 (2c991c196a651f8ef0f36c7763ec87a241b25549) quincy (stable)", 2024-08-15T17:54:09.963 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "0", 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "31310", 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4707, 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 4707 2024-08-15T17:54:09.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 137422185 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 137422185 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.4707 192.168.0.1:0/137422185", 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/137422185", 2024-08-15T17:54:09.965 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2024-08-15T17:54:09.966 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 6, 2024-08-15T17:54:09.966 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 21, 2024-08-15T17:54:09.966 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-08-15T17:54:09.966 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-08-15T17:54:09.966 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-08-15T17:54:09.966 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:54:09.972 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-15T17:54:10.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 Processor -- start 2024-08-15T17:54:10.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 -- start start 2024-08-15T17:54:10.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18a0159340 0x7f18a00ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cddc0 0x7f18a00cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00cef40 con 0x7f18a00cb240 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00ad930 con 0x7f18a0159340 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f18a5615700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00af770 con 0x7f18a00cddc0 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189effd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18a0159340 0x7f18a00ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189e7fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cddc0 0x7f18a00cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189f7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f18a00cb240 0x7f18a00cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:46430/0 (socket says 172.21.15.33:46430) 2024-08-15T17:54:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189f7fe700 1 -- 172.21.15.33:0/1482372579 learned_addr learned my addr 172.21.15.33:0/1482372579 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189effd700 1 -- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cddc0 msgr2=0x7f18a00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189effd700 1 --2- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cddc0 0x7f18a00cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189effd700 1 -- 172.21.15.33:0/1482372579 >> v1:172.21.15.105:6789/0 conn(0x7f18a00cb240 legacy=0x7f18a00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189effd700 1 -- 172.21.15.33:0/1482372579 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00ce330 con 0x7f18a0159340 2024-08-15T17:54:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189effd700 1 --2- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a00ad3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f1898009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02e8379dabc833d server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189dffb700 1 -- 172.21.15.33:0/1482372579 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800e070 con 0x7f18a0159340 2024-08-15T17:54:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189dffb700 1 -- 172.21.15.33:0/1482372579 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800bc80 con 0x7f18a0159340 2024-08-15T17:54:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.083+0000 7f189dffb700 1 -- 172.21.15.33:0/1482372579 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898012430 con 0x7f18a0159340 2024-08-15T17:54:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 -- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 msgr2=0x7f18a00ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 --2- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a00ad3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f1898009780 comp rx=0 tx=0).stop 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 -- 172.21.15.33:0/1482372579 shutdown_connections 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 --2- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cddc0 0x7f18a00cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 --2- 172.21.15.33:0/1482372579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a00ad3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 -- 172.21.15.33:0/1482372579 >> 172.21.15.33:0/1482372579 conn(0x7f18a00994e0 msgr2=0x7f18a00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 -- 172.21.15.33:0/1482372579 shutdown_connections 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 -- 172.21.15.33:0/1482372579 wait complete. 2024-08-15T17:54:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 Processor -- start 2024-08-15T17:54:10.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.087+0000 7f18a5615700 1 -- start start 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cb240 0x7f18a00c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 0x7f18a0156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a0157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c4540 con 0x7f18a00cddc0 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c4820 con 0x7f18a0159340 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c4b00 con 0x7f18a00cb240 2024-08-15T17:54:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 0x7f18a0156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 0x7f18a0156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46642/0 (socket says 172.21.15.33:46642) 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 -- 172.21.15.33:0/1985991102 learned_addr learned my addr 172.21.15.33:0/1985991102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189effd700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cb240 0x7f18a00c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189f7fe700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a0157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 -- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cb240 msgr2=0x7f18a00c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cb240 0x7f18a00c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 -- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 msgr2=0x7f18a0157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a0157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 -- 172.21.15.33:0/1985991102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1898009a20 con 0x7f18a00cddc0 2024-08-15T17:54:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189effd700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cb240 0x7f18a00c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f189e7fc700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 0x7f18a0156bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f189000ec80 tx=0x7f18900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000c9d0 con 0x7f18a00cddc0 2024-08-15T17:54:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000cb30 con 0x7f18a00cddc0 2024-08-15T17:54:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00c4de0 con 0x7f18a00cddc0 2024-08-15T17:54:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890013470 con 0x7f18a00cddc0 2024-08-15T17:54:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a00c4230 con 0x7f18a00cddc0 2024-08-15T17:54:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00645c0 con 0x7f18a00cddc0 2024-08-15T17:54:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.091+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1890013820 con 0x7f18a00cddc0 2024-08-15T17:54:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.095+0000 7f1896ffd700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1884060860 0x7f1884062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.095+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f189007cf90 con 0x7f18a00cddc0 2024-08-15T17:54:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.095+0000 7f189effd700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1884060860 0x7f1884062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.095+0000 7f189effd700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1884060860 0x7f1884062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f1898019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.099+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f18900ad480 con 0x7f18a00cddc0 2024-08-15T17:54:10.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f18a015ed10 con 0x7f18a00cddc0 2024-08-15T17:54:10.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f1896ffd700 1 -- 172.21.15.33:0/1985991102 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1890017070 con 0x7f18a00cddc0 2024-08-15T17:54:10.304 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-15T17:54:10.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1884060860 msgr2=0x7f1884062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1884060860 0x7f1884062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f1898019000 comp rx=0 tx=0).stop 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 msgr2=0x7f18a0156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 0x7f18a0156bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f189000ec80 tx=0x7f18900091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 shutdown_connections 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1884060860 0x7f1884062d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.303+0000 7f18a5615700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0159340 0x7f18a0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.307+0000 7f18a5615700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cddc0 0x7f18a0156bd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.307+0000 7f18a5615700 1 --2- 172.21.15.33:0/1985991102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18a00cb240 0x7f18a00c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.307+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 >> 172.21.15.33:0/1985991102 conn(0x7f18a00994e0 msgr2=0x7f18a00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.307+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 shutdown_connections 2024-08-15T17:54:10.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:10.307+0000 7f18a5615700 1 -- 172.21.15.33:0/1985991102 wait complete. 2024-08-15T17:54:10.318 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-15T17:54:10.318 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-15T17:54:10.318 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-08-15T17:54:10.318 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-15T17:54:10.319 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:10.319 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-15T17:54:10.319 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-15T17:54:10.319 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-15T17:54:10.319 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-15T17:54:10.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.319 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-08-15T17:54:10.324 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:10.324 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:10.325 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42604sec preferred_lft 42604sec 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 02:42:8e:74:25:0d brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.326 INFO:teuthology.orchestra.run.smithi033.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether f6:cf:c1:3a:8a:9b brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::c876:58ff:fea1:c236/64 scope link 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether f6:cf:c1:3a:8a:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::f4cf:c1ff:fe3a:8a9b/64 scope link 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.328 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-15T17:54:10.343 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-08-15T17:54:10.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.344 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-08-15T17:54:10.353 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-08-15T17:54:10.353 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-15T17:54:10.353 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-15T17:54:10.353 INFO:teuthology.orchestra.run.smithi033.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-15T17:54:10.353 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-15T17:54:10.353 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-15T17:54:10.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.354 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:10.354 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:10.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-15T17:54:10.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-15T17:54:10.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-15T17:54:10.354 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:10.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.434 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-15T17:54:10.442 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-15T17:54:10.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.442 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-08-15T17:54:10.493 INFO:teuthology.orchestra.run.smithi033.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-15T17:54:10.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.493 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:10.493 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:10.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-15T17:54:10.494 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-15T17:54:10.494 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:10.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.537 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:10.538 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ba:a2:79:3c:f2:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-15T17:54:10.538 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-15T17:54:10.538 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.538 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::b8a2:79ff:fe3c:f265/64 scope link 2024-08-15T17:54:10.538 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.539 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-15T17:54:10.600 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:10.600 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:10.601 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:10.601 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.601 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ba:a2:79:3c:f2:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::b8a2:79ff:fe3c:f265/64 scope link 2024-08-15T17:54:10.602 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:10.603 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-15T17:54:10.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-15T17:54:10.604 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:10.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:10.670 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:10.670 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:10.670 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.1 up 2024-08-15T17:54:10.670 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.1 master ceph-brx 2024-08-15T17:54:10.670 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:10.700 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-15T17:54:10.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:10.700 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:10.749 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-15T17:54:10.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:10.750 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:10.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:10.773 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:10.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:10.829 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:10.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:10.830 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:10.835 INFO:teuthology.orchestra.run.smithi033.stdout:52 2024-08-15T17:54:10.835 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-15T17:54:10.835 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-15T17:54:10.837 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:10.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:10.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:10.865 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:10.866 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:10.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:10.866 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:10.871 INFO:teuthology.orchestra.run.smithi033.stdout:52 2024-08-15T17:54:10.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi033.stderr:2024-08-15T17:54:10.927+0000 7f80a8cca380 -1 init, newargv = 0x557143d8c9b0 newargc=15 2024-08-15T17:54:10.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi033.stderr:ceph-fuse[31454]: starting ceph client 2024-08-15T17:54:10.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi033.stderr:ceph-fuse[31454]: starting fuse 2024-08-15T17:54:11.972 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:11.991 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:11.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:12.001 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:12.002 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:12.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:12.003 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:12.054 INFO:teuthology.orchestra.run.smithi033.stdout:52 2024-08-15T17:54:12.054 INFO:teuthology.orchestra.run.smithi033.stdout:53 2024-08-15T17:54:12.054 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:12.055 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:12.056 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:12.057 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.2")) 2024-08-15T17:54:12.058 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-08-15T17:54:12.140 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.2.31454.asok 2024-08-15T17:54:12.326 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.31454.asok 2024-08-15T17:54:12.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:12.326 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.31454.asok status 2024-08-15T17:54:12.417 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "2c991c196a651f8ef0f36c7763ec87a241b25549", 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 17.2.7-1375-g2c991c19 (2c991c196a651f8ef0f36c7763ec87a241b25549) quincy (stable)", 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "2", 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "31454", 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-08-15T17:54:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4719, 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 4719 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.2:0", 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 2178798262 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.2:0", 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 2178798262 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.4719 192.168.0.2:0/2178798262", 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.2:0/2178798262", 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 6, 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 21, 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-08-15T17:54:12.420 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:54:12.426 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-15T17:54:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.531+0000 7f14bbe4f700 1 Processor -- start 2024-08-15T17:54:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- start start 2024-08-15T17:54:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14b40ca200 0x7f14b40cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f14b41406a0 0x7f14b4140b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40cde50 con 0x7f14b40ca200 2024-08-15T17:54:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40ad6e0 con 0x7f14b41406a0 2024-08-15T17:54:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4141040 con 0x7f14b415aed0 2024-08-15T17:54:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14b40ca200 0x7f14b40cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14b40ca200 0x7f14b40cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46648/0 (socket says 172.21.15.33:46648) 2024-08-15T17:54:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 -- 172.21.15.33:0/2671621995 learned_addr learned my addr 172.21.15.33:0/2671621995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14ba3ec700 1 --2- 172.21.15.33:0/2671621995 >> v2:172.21.15.105:3300/0 conn(0x7f14b41406a0 0x7f14b4140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 -- 172.21.15.33:0/2671621995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 msgr2=0x7f14b415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b9beb700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 -- 172.21.15.33:0/2671621995 >> v2:172.21.15.105:3300/0 conn(0x7f14b41406a0 msgr2=0x7f14b4140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2671621995 >> v2:172.21.15.105:3300/0 conn(0x7f14b41406a0 0x7f14b4140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 -- 172.21.15.33:0/2671621995 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40c86a0 con 0x7f14b40ca200 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14ba3ec700 1 --2- 172.21.15.33:0/2671621995 >> v2:172.21.15.105:3300/0 conn(0x7f14b41406a0 0x7f14b4140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b9beb700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b40cd910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14b415abe0 tx=0x7f14a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc366722be896d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b8be9700 1 -- 172.21.15.33:0/2671621995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a800e070 con 0x7f14b40ca200 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b8be9700 1 -- 172.21.15.33:0/2671621995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a800ba50 con 0x7f14b40ca200 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14b8be9700 1 -- 172.21.15.33:0/2671621995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80092e0 con 0x7f14b40ca200 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2671621995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 msgr2=0x7f14b40cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b40cd910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14b415abe0 tx=0x7f14a8009840 comp rx=0 tx=0).stop 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2671621995 shutdown_connections 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2671621995 >> v2:172.21.15.105:3300/0 conn(0x7f14b41406a0 0x7f14b4140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b40cd910 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2671621995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2671621995 >> 172.21.15.33:0/2671621995 conn(0x7f14b40caad0 msgr2=0x7f14b40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2671621995 shutdown_connections 2024-08-15T17:54:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.535+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2671621995 wait complete. 2024-08-15T17:54:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 Processor -- start 2024-08-15T17:54:12.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 -- start start 2024-08-15T17:54:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b4156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14b41406a0 0x7f14b4159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b413f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415a570 con 0x7f14b40ca200 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415a290 con 0x7f14b41406a0 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14bbe4f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4158840 con 0x7f14b415aed0 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14b9beb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b4156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14b9beb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b4156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46664/0 (socket says 172.21.15.33:46664) 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14b9beb700 1 -- 172.21.15.33:0/2680163926 learned_addr learned my addr 172.21.15.33:0/2680163926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14ba3ec700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.539+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14b41406a0 0x7f14b4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b9beb700 1 -- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 msgr2=0x7f14b413f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b9beb700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b413f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b9beb700 1 -- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14b41406a0 msgr2=0x7f14b4159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b9beb700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14b41406a0 0x7f14b4159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b9beb700 1 -- 172.21.15.33:0/2680163926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009ae0 con 0x7f14b40ca200 2024-08-15T17:54:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14b41406a0 0x7f14b4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b9beb700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b4156e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c850 tx=0x7f14a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011600 con 0x7f14b40ca200 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4011760 con 0x7f14b40ca200 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b4158b20 con 0x7f14b40ca200 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011b00 con 0x7f14b40ca200 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b4157360 con 0x7f14b40ca200 2024-08-15T17:54:12.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.543+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b41586a0 con 0x7f14b40ca200 2024-08-15T17:54:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.547+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f14a40073b0 con 0x7f14b40ca200 2024-08-15T17:54:12.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.547+0000 7f14b1ffb700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a0060860 0x7f14a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:12.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.547+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14a407cb00 con 0x7f14b40ca200 2024-08-15T17:54:12.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.547+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a0060860 0x7f14a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:12.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.547+0000 7f14b93ea700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a0060860 0x7f14a0062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14b40ca610 tx=0x7f14a8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:12.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.555+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f14b41586a0 con 0x7f14b40ca200 2024-08-15T17:54:12.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.755+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14b41586a0 con 0x7f14b40ca200 2024-08-15T17:54:12.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14b1ffb700 1 -- 172.21.15.33:0/2680163926 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f14b41586a0 con 0x7f14b40ca200 2024-08-15T17:54:12.759 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-15T17:54:12.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a0060860 msgr2=0x7f14a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a0060860 0x7f14a0062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14b40ca610 tx=0x7f14a8018000 comp rx=0 tx=0).stop 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 msgr2=0x7f14b4156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b4156e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c850 tx=0x7f14a4008040 comp rx=0 tx=0).stop 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 shutdown_connections 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a0060860 0x7f14a0062d10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14b41406a0 0x7f14b4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14b415aed0 0x7f14b413f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 --2- 172.21.15.33:0/2680163926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b40ca200 0x7f14b4156e20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 >> 172.21.15.33:0/2680163926 conn(0x7f14b40caad0 msgr2=0x7f14b413d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 shutdown_connections 2024-08-15T17:54:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:12.759+0000 7f14bbe4f700 1 -- 172.21.15.33:0/2680163926 wait complete. 2024-08-15T17:54:12.774 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-15T17:54:12.774 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-15T17:54:12.774 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-08-15T17:54:12.774 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-15T17:54:12.774 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:12.774 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-15T17:54:12.775 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-15T17:54:12.775 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-15T17:54:12.775 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-15T17:54:12.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:12.775 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-08-15T17:54:12.783 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:12.783 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:12.783 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:12.783 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:12.783 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:12.783 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42611sec preferred_lft 42611sec 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:12.784 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-15T17:54:12.785 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:1e:0b:9d:a0 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:12.785 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-15T17:54:12.785 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:12.785 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-15T17:54:12.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:12.785 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:12.785 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:12.785 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2024-08-15T17:54:12.785 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2024-08-15T17:54:12.786 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2024-08-15T17:54:12.786 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-15T17:54:12.786 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:12.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:12.871 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-15T17:54:12.881 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-08-15T17:54:12.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:12.882 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-08-15T17:54:12.911 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-08-15T17:54:12.911 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-15T17:54:12.911 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-15T17:54:12.911 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-15T17:54:12.912 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-15T17:54:12.912 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-15T17:54:12.912 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-15T17:54:12.912 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-15T17:54:12.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:12.912 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:12.912 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:12.912 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-15T17:54:12.912 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-15T17:54:12.913 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-15T17:54:12.913 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:12.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:12.994 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-08-15T17:54:13.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:13.001 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-08-15T17:54:13.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:13.007 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:13.007 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:13.007 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-15T17:54:13.007 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-15T17:54:13.007 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:13.036 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-15T17:54:13.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-15T17:54:13.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-15T17:54:13.037 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:13.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:13.110 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:13.110 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:13.110 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-08-15T17:54:13.110 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2024-08-15T17:54:13.111 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:13.138 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-15T17:54:13.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:13.139 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-15T17:54:13.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:13.144 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:13.148 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:13.209 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:13.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:13.226 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:13.226 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:13.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:13.227 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:13.231 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-15T17:54:13.231 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-15T17:54:13.276 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:13.291 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:13.291 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:13.300 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:13.301 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:13.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:13.301 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:13.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:2024-08-15T17:54:13.361+0000 7fb08ea90380 -1 init, newargv = 0x5597697425e0 newargc=15 2024-08-15T17:54:13.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[29898]: starting ceph client 2024-08-15T17:54:13.373 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[29898]: starting fuse 2024-08-15T17:54:14.452 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:14.471 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:14.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:14.481 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:14.482 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:14.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:14.483 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:14.530 INFO:teuthology.orchestra.run.smithi105.stdout:52 2024-08-15T17:54:14.531 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> import glob 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> import re 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> import subprocess 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> def _find_admin_socket(client_name): 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-15T17:54:14.531 DEBUG:teuthology.orchestra.run.smithi105:> files = glob.glob(asok_path) 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> # Given a non-glob path, it better be there 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> if "*" not in asok_path: 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> assert(len(files) == 1) 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> return files[0] 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> for f in files: 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-15T17:54:14.532 DEBUG:teuthology.orchestra.run.smithi105:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> contents = proc_f.read() 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> if mountpoint in contents: 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> return f 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> print(_find_admin_socket("client.1")) 2024-08-15T17:54:14.533 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-08-15T17:54:14.616 INFO:teuthology.orchestra.run.smithi105.stdout:/var/run/ceph/ceph-client.1.29898.asok 2024-08-15T17:54:14.803 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.29898.asok 2024-08-15T17:54:14.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:14.803 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.29898.asok status 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "metadata": { 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_sha1": "2c991c196a651f8ef0f36c7763ec87a241b25549", 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 17.2.7-1375-g2c991c19 (2c991c196a651f8ef0f36c7763ec87a241b25549) quincy (stable)", 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "entity_id": "1", 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "hostname": "smithi105", 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "pid": "29898", 2024-08-15T17:54:14.902 INFO:teuthology.orchestra.run.smithi105.stdout: "root": "/" 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_count": 0, 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_pinned_count": 0, 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4714, 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "inst": { 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "name": { 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4714 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-08-15T17:54:14.903 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 1245668994 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 1245668994 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "inst_str": "client.4714 192.168.0.1:0/1245668994", 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "addr_str": "192.168.0.1:0/1245668994", 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "inode_count": 1, 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_epoch": 6, 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch": 21, 2024-08-15T17:54:14.904 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch_barrier": 0, 2024-08-15T17:54:14.905 INFO:teuthology.orchestra.run.smithi105.stdout: "blocklisted": false, 2024-08-15T17:54:14.905 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs" 2024-08-15T17:54:14.905 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-08-15T17:54:14.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-15T17:54:15.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 Processor -- start 2024-08-15T17:54:15.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 -- start start 2024-08-15T17:54:15.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a2806e130 0x7f1a280686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a28068be0 0x7f1a28160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280c36f0 con 0x7f1a28157060 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280caec0 con 0x7f1a28068be0 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.023+0000 7f1a2d8a8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28069020 con 0x7f1a2806e130 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a26ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1a28157060 0x7f1a2806a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40870/0 (socket says 172.21.15.33:40870) 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a26ffd700 1 -- 172.21.15.33:0/681458545 learned_addr learned my addr 172.21.15.33:0/681458545 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a267fc700 1 --2- 172.21.15.33:0/681458545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a2806e130 0x7f1a280686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a277fe700 1 --2- 172.21.15.33:0/681458545 >> v2:172.21.15.105:3300/0 conn(0x7f1a28068be0 0x7f1a28160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:15.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a25ffb700 1 -- 172.21.15.33:0/681458545 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381630418 0 0) 0x7f1a280c36f0 con 0x7f1a28157060 2024-08-15T17:54:15.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a25ffb700 1 -- 172.21.15.33:0/681458545 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a10003570 con 0x7f1a28157060 2024-08-15T17:54:15.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a267fc700 1 -- 172.21.15.33:0/681458545 >> v2:172.21.15.105:3300/0 conn(0x7f1a28068be0 msgr2=0x7f1a28160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:15.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a267fc700 1 --2- 172.21.15.33:0/681458545 >> v2:172.21.15.105:3300/0 conn(0x7f1a28068be0 0x7f1a28160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a267fc700 1 -- 172.21.15.33:0/681458545 >> v1:172.21.15.33:6789/0 conn(0x7f1a28157060 legacy=0x7f1a2806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:15.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a267fc700 1 -- 172.21.15.33:0/681458545 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2806e560 con 0x7f1a2806e130 2024-08-15T17:54:15.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a267fc700 1 --2- 172.21.15.33:0/681458545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a2806e130 0x7f1a280686a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0098e0 tx=0x7f1a1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=803d82420b71bc2a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:15.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a25ffb700 1 -- 172.21.15.33:0/681458545 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c011630 con 0x7f1a2806e130 2024-08-15T17:54:15.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a25ffb700 1 -- 172.21.15.33:0/681458545 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c011790 con 0x7f1a2806e130 2024-08-15T17:54:15.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a25ffb700 1 -- 172.21.15.33:0/681458545 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c011b30 con 0x7f1a2806e130 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/681458545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a2806e130 msgr2=0x7f1a280686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/681458545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a2806e130 0x7f1a280686a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0098e0 tx=0x7f1a1c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/681458545 shutdown_connections 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/681458545 >> v2:172.21.15.105:3300/0 conn(0x7f1a28068be0 0x7f1a28160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/681458545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a2806e130 0x7f1a280686a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/681458545 >> 172.21.15.33:0/681458545 conn(0x7f1a280c9c20 msgr2=0x7f1a2806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/681458545 shutdown_connections 2024-08-15T17:54:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.027+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/681458545 wait complete. 2024-08-15T17:54:15.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 Processor -- start 2024-08-15T17:54:15.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 -- start start 2024-08-15T17:54:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a28068be0 0x7f1a28167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a2806e130 0x7f1a2814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 0x7f1a280c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281544f0 con 0x7f1a28157060 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28168150 con 0x7f1a2806e130 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a2d8a8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2814e610 con 0x7f1a28068be0 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 0x7f1a280c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 0x7f1a280c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46678/0 (socket says 172.21.15.33:46678) 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 -- 172.21.15.33:0/1935377397 learned_addr learned my addr 172.21.15.33:0/1935377397 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a267fc700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a2806e130 0x7f1a2814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a26ffd700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a28068be0 0x7f1a28167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 -- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a28068be0 msgr2=0x7f1a28167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a28068be0 0x7f1a28167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 -- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a2806e130 msgr2=0x7f1a2814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a2806e130 0x7f1a2814d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 -- 172.21.15.33:0/1935377397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009420 con 0x7f1a28157060 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a26ffd700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a28068be0 0x7f1a28167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.031+0000 7f1a277fe700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 0x7f1a280c5350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009df0 tx=0x7f1a2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000cb50 con 0x7f1a28157060 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000f040 con 0x7f1a28157060 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2816a930 con 0x7f1a28157060 2024-08-15T17:54:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20014480 con 0x7f1a28157060 2024-08-15T17:54:15.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2816af70 con 0x7f1a28157060 2024-08-15T17:54:15.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a280645c0 con 0x7f1a28157060 2024-08-15T17:54:15.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a20014830 con 0x7f1a28157060 2024-08-15T17:54:15.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a0effd700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a14060860 0x7f1a14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.035+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a2007d580 con 0x7f1a28157060 2024-08-15T17:54:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.039+0000 7f1a26ffd700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a14060860 0x7f1a14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.039+0000 7f1a26ffd700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a14060860 0x7f1a14062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a280c5eb0 tx=0x7f1a18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.043+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a2004d930 con 0x7f1a28157060 2024-08-15T17:54:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.239+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a280c6290 con 0x7f1a28157060 2024-08-15T17:54:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.239+0000 7f1a0effd700 1 -- 172.21.15.33:0/1935377397 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a20050f50 con 0x7f1a28157060 2024-08-15T17:54:15.242 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-15T17:54:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a14060860 msgr2=0x7f1a14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a14060860 0x7f1a14062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a280c5eb0 tx=0x7f1a18009040 comp rx=0 tx=0).stop 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 msgr2=0x7f1a280c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 0x7f1a280c5350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009df0 tx=0x7f1a2000b040 comp rx=0 tx=0).stop 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 shutdown_connections 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1a14060860 0x7f1a14062d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a2806e130 0x7f1a2814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a28157060 0x7f1a280c5350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 --2- 172.21.15.33:0/1935377397 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a28068be0 0x7f1a28167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 >> 172.21.15.33:0/1935377397 conn(0x7f1a280c9c20 msgr2=0x7f1a280c2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 shutdown_connections 2024-08-15T17:54:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:15.243+0000 7f1a2d8a8700 1 -- 172.21.15.33:0/1935377397 wait complete. 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-15T17:54:15.256 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-15T17:54:15.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.257 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.264 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42609sec preferred_lft 42609sec 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-15T17:54:15.265 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:1e:0b:9d:a0 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 82:e7:7b:d2:ac:8d brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::e0f9:45ff:fe3e:6f59/64 scope link 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 82:e7:7b:d2:ac:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80e7:7bff:fed2:ac8d/64 scope link 2024-08-15T17:54:15.266 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.268 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-15T17:54:15.281 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-08-15T17:54:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.283 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-15T17:54:15.292 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-15T17:54:15.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.293 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:15.293 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:15.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-15T17:54:15.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-15T17:54:15.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-15T17:54:15.293 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:15.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.375 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-08-15T17:54:15.382 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-15T17:54:15.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.383 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-08-15T17:54:15.389 INFO:teuthology.orchestra.run.smithi105.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-15T17:54:15.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.390 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:15.390 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:15.390 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-15T17:54:15.390 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-15T17:54:15.390 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:15.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.467 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:15.481 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 46:ba:76:5f:b4:48 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-15T17:54:15.482 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-15T17:54:15.482 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.482 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::44ba:76ff:fe5f:b448/64 scope link 2024-08-15T17:54:15.482 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.483 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-15T17:54:15.494 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:15.494 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:15.494 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:15.494 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.494 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 46:ba:76:5f:b4:48 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::44ba:76ff:fe5f:b448/64 scope link 2024-08-15T17:54:15.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:15.496 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-15T17:54:15.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-15T17:54:15.497 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:15.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:15.554 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:15.554 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:15.554 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.1 up 2024-08-15T17:54:15.555 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.1 master ceph-brx 2024-08-15T17:54:15.555 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:15.583 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-15T17:54:15.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:15.583 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:15.588 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-15T17:54:15.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:15.588 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:15.593 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:15.607 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:15.607 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:15.621 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:15.622 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:15.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:15.623 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:15.671 INFO:teuthology.orchestra.run.smithi105.stdout:52 2024-08-15T17:54:15.671 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-15T17:54:15.671 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-15T17:54:15.674 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:15.691 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:15.691 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:15.701 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:15.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:15.701 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:15.750 INFO:teuthology.orchestra.run.smithi105.stdout:52 2024-08-15T17:54:15.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi105.stderr:2024-08-15T17:54:15.761+0000 7f2e71a38380 -1 init, newargv = 0x564ec721ba10 newargc=15 2024-08-15T17:54:15.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi105.stderr:ceph-fuse[30012]: starting ceph client 2024-08-15T17:54:15.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi105.stderr:ceph-fuse[30012]: starting fuse 2024-08-15T17:54:16.853 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:16.871 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:16.872 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:16.931 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:16.932 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:16.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:16.933 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:16.940 INFO:teuthology.orchestra.run.smithi105.stdout:52 2024-08-15T17:54:16.940 INFO:teuthology.orchestra.run.smithi105.stdout:53 2024-08-15T17:54:16.940 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-15T17:54:16.940 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-15T17:54:16.940 DEBUG:teuthology.orchestra.run.smithi105:> import glob 2024-08-15T17:54:16.940 DEBUG:teuthology.orchestra.run.smithi105:> import re 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> import subprocess 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> def _find_admin_socket(client_name): 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> files = glob.glob(asok_path) 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> # Given a non-glob path, it better be there 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> if "*" not in asok_path: 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> assert(len(files) == 1) 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> return files[0] 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:16.941 DEBUG:teuthology.orchestra.run.smithi105:> for f in files: 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> contents = proc_f.read() 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> if mountpoint in contents: 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> return f 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> print(_find_admin_socket("client.3")) 2024-08-15T17:54:16.942 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-08-15T17:54:17.023 INFO:teuthology.orchestra.run.smithi105.stdout:/var/run/ceph/ceph-client.3.30012.asok 2024-08-15T17:54:17.209 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.30012.asok 2024-08-15T17:54:17.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.30012.asok status 2024-08-15T17:54:17.301 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-08-15T17:54:17.301 INFO:teuthology.orchestra.run.smithi105.stdout: "metadata": { 2024-08-15T17:54:17.301 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_sha1": "2c991c196a651f8ef0f36c7763ec87a241b25549", 2024-08-15T17:54:17.301 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 17.2.7-1375-g2c991c19 (2c991c196a651f8ef0f36c7763ec87a241b25549) quincy (stable)", 2024-08-15T17:54:17.301 INFO:teuthology.orchestra.run.smithi105.stdout: "entity_id": "3", 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "hostname": "smithi105", 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "pid": "30012", 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "root": "/" 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_count": 0, 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_pinned_count": 0, 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4729, 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "inst": { 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "name": { 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4729 2024-08-15T17:54:17.302 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.2:0", 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 393861429 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.2:0", 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 393861429 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "inst_str": "client.4729 192.168.0.2:0/393861429", 2024-08-15T17:54:17.303 INFO:teuthology.orchestra.run.smithi105.stdout: "addr_str": "192.168.0.2:0/393861429", 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout: "inode_count": 1, 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_epoch": 6, 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch": 21, 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch_barrier": 0, 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout: "blocklisted": false, 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs" 2024-08-15T17:54:17.304 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-08-15T17:54:17.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.310 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-08-15T17:54:17.310 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:17.318 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-08-15T17:54:17.319 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:17.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:17.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.382 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-08-15T17:54:17.382 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:17.391 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-08-15T17:54:17.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:17.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:17.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.455 DEBUG:teuthology.orchestra.run.smithi105:> stat --file-system '--printf=%T 2024-08-15T17:54:17.456 DEBUG:teuthology.orchestra.run.smithi105:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:17.464 INFO:teuthology.orchestra.run.smithi105.stdout:fuseblk 2024-08-15T17:54:17.464 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:17.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.464 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:17.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.522 DEBUG:teuthology.orchestra.run.smithi105:> stat --file-system '--printf=%T 2024-08-15T17:54:17.522 DEBUG:teuthology.orchestra.run.smithi105:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:17.530 INFO:teuthology.orchestra.run.smithi105.stdout:fuseblk 2024-08-15T17:54:17.530 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:17.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:17.530 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:17.543 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-15T17:54:17.560 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:17.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 Processor -- start 2024-08-15T17:54:17.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 -- start start 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7458153320 0x7f74581536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f745815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745815dbd0 con 0x7f745815a190 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74580ce430 con 0x7f7458153320 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745815d370 con 0x7f74580cd1b0 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7458153320 0x7f74581536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f7455d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f745815a190 0x7f74580ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40884/0 (socket says 172.21.15.33:40884) 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7458153320 0x7f74581536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46684/0 (socket says 172.21.15.33:46684) 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f7455d9b700 1 -- 172.21.15.33:0/2824051477 learned_addr learned my addr 172.21.15.33:0/2824051477 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f7456d9d700 1 --2- 172.21.15.33:0/2824051477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f745815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 -- 172.21.15.33:0/2824051477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 msgr2=0x7f745815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 --2- 172.21.15.33:0/2824051477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f745815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 -- 172.21.15.33:0/2824051477 >> v1:172.21.15.33:6789/0 conn(0x7f745815a190 legacy=0x7f74580ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745559a700 1 -- 172.21.15.33:0/2824051477 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618470972 0 0) 0x7f745815dbd0 con 0x7f745815a190 2024-08-15T17:54:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 -- 172.21.15.33:0/2824051477 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745815a590 con 0x7f7458153320 2024-08-15T17:54:17.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.675+0000 7f745659c700 1 --2- 172.21.15.33:0/2824051477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f74581536f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74480098e0 tx=0x7f74480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1198e2545230a31 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:17.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745559a700 1 -- 172.21.15.33:0/2824051477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448009e80 con 0x7f7458153320 2024-08-15T17:54:17.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745559a700 1 -- 172.21.15.33:0/2824051477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800b860 con 0x7f7458153320 2024-08-15T17:54:17.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745559a700 1 -- 172.21.15.33:0/2824051477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800bbe0 con 0x7f7458153320 2024-08-15T17:54:17.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 -- 172.21.15.33:0/2824051477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 msgr2=0x7f74581536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 --2- 172.21.15.33:0/2824051477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f74581536f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74480098e0 tx=0x7f74480091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 -- 172.21.15.33:0/2824051477 shutdown_connections 2024-08-15T17:54:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 --2- 172.21.15.33:0/2824051477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f745815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 --2- 172.21.15.33:0/2824051477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f74581536f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 -- 172.21.15.33:0/2824051477 >> 172.21.15.33:0/2824051477 conn(0x7f74580d00a0 msgr2=0x7f74580d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 -- 172.21.15.33:0/2824051477 shutdown_connections 2024-08-15T17:54:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.679+0000 7f745759e700 1 -- 172.21.15.33:0/2824051477 wait complete. 2024-08-15T17:54:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 Processor -- start 2024-08-15T17:54:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 -- start start 2024-08-15T17:54:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f74580b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f7458151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745815a190 0x7f74580cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580b4060 con 0x7f7458153320 2024-08-15T17:54:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580b4340 con 0x7f745815a190 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74580b4620 con 0x7f74580cd1b0 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f7458151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f7458151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46690/0 (socket says 172.21.15.33:46690) 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 -- 172.21.15.33:0/277244202 learned_addr learned my addr 172.21.15.33:0/277244202 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7456d9d700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745815a190 0x7f74580cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745659c700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f74580b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 -- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 msgr2=0x7f74580b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f74580b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 -- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745815a190 msgr2=0x7f74580cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745815a190 0x7f74580cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 -- 172.21.15.33:0/277244202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448009420 con 0x7f7458153320 2024-08-15T17:54:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f7455d9b700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f7458151b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f744000c5b0 tx=0x7f7440001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440005b30 con 0x7f7458153320 2024-08-15T17:54:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440005c90 con 0x7f7458153320 2024-08-15T17:54:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74580b4900 con 0x7f7458153320 2024-08-15T17:54:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440007300 con 0x7f7458153320 2024-08-15T17:54:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.683+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7458152070 con 0x7f7458153320 2024-08-15T17:54:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.687+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74580638f0 con 0x7f7458153320 2024-08-15T17:54:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.687+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f744001b3b0 con 0x7f7458153320 2024-08-15T17:54:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.687+0000 7f744e7fc700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7438060860 0x7f7438062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.687+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f744007bff0 con 0x7f7458153320 2024-08-15T17:54:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.687+0000 7f745659c700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7438060860 0x7f7438062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.691+0000 7f745659c700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7438060860 0x7f7438062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74480091e0 tx=0x7f7448017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:17.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.695+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f744004c440 con 0x7f7458153320 2024-08-15T17:54:17.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.859+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74580cde20 con 0x7f7458153320 2024-08-15T17:54:17.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.859+0000 7f744e7fc700 1 -- 172.21.15.33:0/277244202 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f744004fa60 con 0x7f7458153320 2024-08-15T17:54:17.861 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:17.861 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:17.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7438060860 msgr2=0x7f7438062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7438060860 0x7f7438062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74480091e0 tx=0x7f7448017000 comp rx=0 tx=0).stop 2024-08-15T17:54:17.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 msgr2=0x7f7458151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f7458151b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f744000c5b0 tx=0x7f7440001070 comp rx=0 tx=0).stop 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 shutdown_connections 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7438060860 0x7f7438062d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745815a190 0x7f74580cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7458153320 0x7f7458151b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 --2- 172.21.15.33:0/277244202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74580cd1b0 0x7f74580b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 >> 172.21.15.33:0/277244202 conn(0x7f74580d00a0 msgr2=0x7f74580ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 shutdown_connections 2024-08-15T17:54:17.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.863+0000 7f745759e700 1 -- 172.21.15.33:0/277244202 wait complete. 2024-08-15T17:54:17.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:17.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:17.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 Processor -- start 2024-08-15T17:54:17.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 -- start start 2024-08-15T17:54:17.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d50159300 0x7f0d500b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d50066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d500cba90 con 0x7f0d5015dbc0 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d500b2b60 con 0x7f0d50159300 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d56638700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500cb160 con 0x7f0d501596d0 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d54bd5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0d5015dbc0 0x7f0d500afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42356/0 (socket says 172.21.15.33:42356) 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d54bd5700 1 -- 172.21.15.33:0/813974994 learned_addr learned my addr 172.21.15.33:0/813974994 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d4f7fe700 1 --2- 172.21.15.33:0/813974994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d50066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d4ffff700 1 --2- 172.21.15.33:0/813974994 >> v2:172.21.15.105:3300/0 conn(0x7f0d50159300 0x7f0d500b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d4effd700 1 -- 172.21.15.33:0/813974994 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747211335 0 0) 0x7f0d500cba90 con 0x7f0d5015dbc0 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.991+0000 7f0d4effd700 1 -- 172.21.15.33:0/813974994 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d38003570 con 0x7f0d5015dbc0 2024-08-15T17:54:17.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4f7fe700 1 -- 172.21.15.33:0/813974994 >> v2:172.21.15.105:3300/0 conn(0x7f0d50159300 msgr2=0x7f0d500b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:17.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4f7fe700 1 --2- 172.21.15.33:0/813974994 >> v2:172.21.15.105:3300/0 conn(0x7f0d50159300 0x7f0d500b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4f7fe700 1 -- 172.21.15.33:0/813974994 >> v1:172.21.15.33:6789/0 conn(0x7f0d5015dbc0 legacy=0x7f0d500afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4f7fe700 1 -- 172.21.15.33:0/813974994 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d500cb440 con 0x7f0d501596d0 2024-08-15T17:54:17.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4f7fe700 1 --2- 172.21.15.33:0/813974994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d50066e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098e0 tx=0x7f0d440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b67b7e1ff2d8e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4effd700 1 -- 172.21.15.33:0/813974994 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44011630 con 0x7f0d501596d0 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4effd700 1 -- 172.21.15.33:0/813974994 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44011790 con 0x7f0d501596d0 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d4effd700 1 -- 172.21.15.33:0/813974994 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44011b10 con 0x7f0d501596d0 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 -- 172.21.15.33:0/813974994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 msgr2=0x7f0d50066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 --2- 172.21.15.33:0/813974994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d50066e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098e0 tx=0x7f0d440091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 -- 172.21.15.33:0/813974994 shutdown_connections 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 --2- 172.21.15.33:0/813974994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d50066e00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 --2- 172.21.15.33:0/813974994 >> v2:172.21.15.105:3300/0 conn(0x7f0d50159300 0x7f0d500b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 -- 172.21.15.33:0/813974994 >> 172.21.15.33:0/813974994 conn(0x7f0d500682c0 msgr2=0x7f0d500686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 -- 172.21.15.33:0/813974994 shutdown_connections 2024-08-15T17:54:17.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.995+0000 7f0d56638700 1 -- 172.21.15.33:0/813974994 wait complete. 2024-08-15T17:54:17.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 Processor -- start 2024-08-15T17:54:18.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 -- start start 2024-08-15T17:54:18.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d50159300 0x7f0d500c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d5015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 0x7f0d500c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500c77a0 con 0x7f0d5015dbc0 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500c9f50 con 0x7f0d50159300 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500ca230 con 0x7f0d501596d0 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 0x7f0d500c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 0x7f0d500c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46442/0 (socket says 172.21.15.33:46442) 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 -- 172.21.15.33:0/715658112 learned_addr learned my addr 172.21.15.33:0/715658112 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d4ffff700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d50159300 0x7f0d500c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d4f7fe700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d5015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 -- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 msgr2=0x7f0d5015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d5015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 -- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d50159300 msgr2=0x7f0d500c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d50159300 0x7f0d500c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 -- 172.21.15.33:0/715658112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009420 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d54bd5700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 0x7f0d500c3dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d480010e0 tx=0x7f0d48007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48005c00 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48005d60 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5015b480 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:17.999+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480072e0 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.003+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5015c1c0 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.003+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5015b950 con 0x7f0d5015dbc0 2024-08-15T17:54:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.003+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d48012400 con 0x7f0d5015dbc0 2024-08-15T17:54:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.003+0000 7f0d37fff700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0d3c060860 0x7f0d3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.003+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d4807bee0 con 0x7f0d5015dbc0 2024-08-15T17:54:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.003+0000 7f0d4ffff700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0d3c060860 0x7f0d3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.007+0000 7f0d4ffff700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0d3c060860 0x7f0d3c062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009fd0 tx=0x7f0d4000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.011+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d4804a480 con 0x7f0d5015dbc0 2024-08-15T17:54:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.175+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d500645c0 con 0x7f0d5015dbc0 2024-08-15T17:54:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.179+0000 7f0d37fff700 1 -- 172.21.15.33:0/715658112 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d4804c3e0 con 0x7f0d5015dbc0 2024-08-15T17:54:18.178 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0d3c060860 msgr2=0x7f0d3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0d3c060860 0x7f0d3c062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009fd0 tx=0x7f0d4000b040 comp rx=0 tx=0).stop 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 msgr2=0x7f0d500c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 0x7f0d500c3dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d480010e0 tx=0x7f0d48007dd0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 shutdown_connections 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0d3c060860 0x7f0d3c062d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5015dbc0 0x7f0d500c3dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d501596d0 0x7f0d5015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 --2- 172.21.15.33:0/715658112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d50159300 0x7f0d500c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 >> 172.21.15.33:0/715658112 conn(0x7f0d500682c0 msgr2=0x7f0d500b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:18.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 shutdown_connections 2024-08-15T17:54:18.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.183+0000 7f0d56638700 1 -- 172.21.15.33:0/715658112 wait complete. 2024-08-15T17:54:18.199 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c7b4cd700 1 Processor -- start 2024-08-15T17:54:18.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c7b4cd700 1 -- start start 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c7b4cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74068db0 0x7f2c741606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c7b4cd700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7406b000 con 0x7f2c741554c0 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c7b4cd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7406a3f0 con 0x7f2c74155890 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c7b4cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7406a6d0 con 0x7f2c74068db0 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c79269700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2c741554c0 0x7f2c740699a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42368/0 (socket says 172.21.15.33:42368) 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c79269700 1 -- 172.21.15.33:0/352354854 learned_addr learned my addr 172.21.15.33:0/352354854 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c79a6a700 1 --2- 172.21.15.33:0/352354854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74068db0 0x7f2c741606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c6bfff700 1 -- 172.21.15.33:0/352354854 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821259675 0 0) 0x7f2c7406b000 con 0x7f2c741554c0 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c6bfff700 1 -- 172.21.15.33:0/352354854 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c60004680 con 0x7f2c741554c0 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c79a6a700 1 -- 172.21.15.33:0/352354854 >> v1:172.21.15.105:6789/0 conn(0x7f2c74155890 legacy=0x7f2c740686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c79a6a700 1 -- 172.21.15.33:0/352354854 >> v1:172.21.15.33:6789/0 conn(0x7f2c741554c0 legacy=0x7f2c740699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c6bfff700 1 -- 172.21.15.33:0/352354854 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420642565 0 0) 0x7f2c60004680 con 0x7f2c741554c0 2024-08-15T17:54:18.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.315+0000 7f2c79a6a700 1 -- 172.21.15.33:0/352354854 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7406a9b0 con 0x7f2c74068db0 2024-08-15T17:54:18.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c79a6a700 1 --2- 172.21.15.33:0/352354854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74068db0 0x7f2c741606b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009910 tx=0x7f2c640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b46eb088cea015 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c6bfff700 1 -- 172.21.15.33:0/352354854 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0017f0 con 0x7f2c74068db0 2024-08-15T17:54:18.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c6bfff700 1 -- 172.21.15.33:0/352354854 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c64011420 con 0x7f2c74068db0 2024-08-15T17:54:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c6bfff700 1 -- 172.21.15.33:0/352354854 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640117e0 con 0x7f2c74068db0 2024-08-15T17:54:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/352354854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74068db0 msgr2=0x7f2c741606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/352354854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74068db0 0x7f2c741606b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009910 tx=0x7f2c640091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/352354854 shutdown_connections 2024-08-15T17:54:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/352354854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74068db0 0x7f2c741606b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.319+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/352354854 >> 172.21.15.33:0/352354854 conn(0x7f2c740c9bf0 msgr2=0x7f2c7406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:18.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/352354854 shutdown_connections 2024-08-15T17:54:18.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/352354854 wait complete. 2024-08-15T17:54:18.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 Processor -- start 2024-08-15T17:54:18.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 -- start start 2024-08-15T17:54:18.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c74068db0 0x7f2c74143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 0x7f2c740abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74155890 0x7f2c74151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740ca980 con 0x7f2c741554c0 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740a9d70 con 0x7f2c74068db0 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.323+0000 7f2c7b4cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740cab70 con 0x7f2c74155890 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 0x7f2c740abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 0x7f2c740abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46446/0 (socket says 172.21.15.33:46446) 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 -- 172.21.15.33:0/441581229 learned_addr learned my addr 172.21.15.33:0/441581229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c79269700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c74068db0 0x7f2c74143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c79a6a700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74155890 0x7f2c74151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 -- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74155890 msgr2=0x7f2c74151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74155890 0x7f2c74151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 -- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c74068db0 msgr2=0x7f2c74143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c74068db0 0x7f2c74143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 -- 172.21.15.33:0/441581229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009420 con 0x7f2c741554c0 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c78a68700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 0x7f2c740abc30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000c4e0 tx=0x7f2c7000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70011590 con 0x7f2c741554c0 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70011710 con 0x7f2c741554c0 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c740cae10 con 0x7f2c741554c0 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70011ad0 con 0x7f2c741554c0 2024-08-15T17:54:18.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c74143640 con 0x7f2c741554c0 2024-08-15T17:54:18.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c740a9860 con 0x7f2c741554c0 2024-08-15T17:54:18.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.327+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2c70001020 con 0x7f2c741554c0 2024-08-15T17:54:18.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.331+0000 7f2c697fa700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2c58060860 0x7f2c58062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.331+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c7007bed0 con 0x7f2c741554c0 2024-08-15T17:54:18.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.331+0000 7f2c79269700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2c58060860 0x7f2c58062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.331+0000 7f2c79269700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2c58060860 0x7f2c58062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c740cb680 tx=0x7f2c6c000f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.335+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2c740a9860 con 0x7f2c741554c0 2024-08-15T17:54:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.499+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c740a9860 con 0x7f2c741554c0 2024-08-15T17:54:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.499+0000 7f2c697fa700 1 -- 172.21.15.33:0/441581229 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c70017020 con 0x7f2c741554c0 2024-08-15T17:54:18.502 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2c58060860 msgr2=0x7f2c58062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2c58060860 0x7f2c58062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c740cb680 tx=0x7f2c6c000f40 comp rx=0 tx=0).stop 2024-08-15T17:54:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 msgr2=0x7f2c740abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 0x7f2c740abc30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000c4e0 tx=0x7f2c7000c7f0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 shutdown_connections 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2c58060860 0x7f2c58062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c74155890 0x7f2c74151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741554c0 0x7f2c740abc30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 --2- 172.21.15.33:0/441581229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c74068db0 0x7f2c74143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 >> 172.21.15.33:0/441581229 conn(0x7f2c740c9bf0 msgr2=0x7f2c74066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 shutdown_connections 2024-08-15T17:54:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.503+0000 7f2c7b4cd700 1 -- 172.21.15.33:0/441581229 wait complete. 2024-08-15T17:54:18.517 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:18.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.635+0000 7fbe9ffff700 1 Processor -- start 2024-08-15T17:54:18.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.635+0000 7fbe9ffff700 1 -- start start 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbea006a040 0x7fbea013abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9ffff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea013be40 con 0x7fbea0155c30 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9ffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea013d930 con 0x7fbea0156000 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9ffff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea013b230 con 0x7fbea006a040 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbea0155c30 0x7fbea0069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42374/0 (socket says 172.21.15.33:42374) 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbea006a040 0x7fbea013abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9effd700 1 -- 172.21.15.33:0/3542723212 learned_addr learned my addr 172.21.15.33:0/3542723212 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:18.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9e7fc700 1 -- 172.21.15.33:0/3542723212 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155437586 0 0) 0x7fbea013be40 con 0x7fbea0155c30 2024-08-15T17:54:18.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9e7fc700 1 -- 172.21.15.33:0/3542723212 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe8c003570 con 0x7fbea0155c30 2024-08-15T17:54:18.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/3542723212 >> v1:172.21.15.105:6789/0 conn(0x7fbea0156000 legacy=0x7fbea013a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/3542723212 >> v1:172.21.15.33:6789/0 conn(0x7fbea0155c30 legacy=0x7fbea0069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/3542723212 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea013b510 con 0x7fbea006a040 2024-08-15T17:54:18.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9f7fe700 1 --2- 172.21.15.33:0/3542723212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006a040 0x7fbea013abd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e60 tx=0x7fbe98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7d7b713073e6fc server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9e7fc700 1 -- 172.21.15.33:0/3542723212 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800e070 con 0x7fbea006a040 2024-08-15T17:54:18.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9e7fc700 1 -- 172.21.15.33:0/3542723212 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800bb60 con 0x7fbea006a040 2024-08-15T17:54:18.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9e7fc700 1 -- 172.21.15.33:0/3542723212 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98012430 con 0x7fbea006a040 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9ffff700 1 -- 172.21.15.33:0/3542723212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006a040 msgr2=0x7fbea013abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.639+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/3542723212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006a040 0x7fbea013abd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e60 tx=0x7fbe98009780 comp rx=0 tx=0).stop 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- 172.21.15.33:0/3542723212 shutdown_connections 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/3542723212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006a040 0x7fbea013abd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- 172.21.15.33:0/3542723212 >> 172.21.15.33:0/3542723212 conn(0x7fbea006e170 msgr2=0x7fbea006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- 172.21.15.33:0/3542723212 shutdown_connections 2024-08-15T17:54:18.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- 172.21.15.33:0/3542723212 wait complete. 2024-08-15T17:54:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 Processor -- start 2024-08-15T17:54:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- start start 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea006a040 0x7fbea00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea0155c30 0x7fbea0158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 0x7fbea0158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0165aa0 con 0x7fbea0156000 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea013ad50 con 0x7fbea006a040 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9ffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00c8e60 con 0x7fbea0155c30 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 0x7fbea0158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.643+0000 7fbe9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 0x7fbea0158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46458/0 (socket says 172.21.15.33:46458) 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/1063068370 learned_addr learned my addr 172.21.15.33:0/1063068370 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9effd700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea006a040 0x7fbea00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe967fc700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea0155c30 0x7fbea0158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea0155c30 msgr2=0x7fbea0158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea0155c30 0x7fbea0158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea006a040 msgr2=0x7fbea00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea006a040 0x7fbea00cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 -- 172.21.15.33:0/1063068370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009a20 con 0x7fbea0156000 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9f7fe700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 0x7fbea0158660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbea006cc80 tx=0x7fbe98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98012c20 con 0x7fbea0156000 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98021070 con 0x7fbea0156000 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea00c9420 con 0x7fbea0156000 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98026430 con 0x7fbea0156000 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea01572c0 con 0x7fbea0156000 2024-08-15T17:54:18.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.647+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea00c95b0 con 0x7fbea0156000 2024-08-15T17:54:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.651+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe98023030 con 0x7fbea0156000 2024-08-15T17:54:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.651+0000 7fbe977fe700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe80060860 0x7fbe80062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.651+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe9807f110 con 0x7fbea0156000 2024-08-15T17:54:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.651+0000 7fbe9effd700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe80060860 0x7fbe80062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.651+0000 7fbe9effd700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe80060860 0x7fbe80062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe90007fd0 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.659+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe9804f540 con 0x7fbea0156000 2024-08-15T17:54:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbea00638f0 con 0x7fbea0156000 2024-08-15T17:54:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe977fe700 1 -- 172.21.15.33:0/1063068370 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe98052b60 con 0x7fbea0156000 2024-08-15T17:54:18.824 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe80060860 msgr2=0x7fbe80062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe80060860 0x7fbe80062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe90007fd0 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2024-08-15T17:54:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 msgr2=0x7fbea0158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 0x7fbea0158660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbea006cc80 tx=0x7fbe98019000 comp rx=0 tx=0).stop 2024-08-15T17:54:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 shutdown_connections 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbe80060860 0x7fbe80062d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea0156000 0x7fbea0158660 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea0155c30 0x7fbea0158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 --2- 172.21.15.33:0/1063068370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea006a040 0x7fbea00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 >> 172.21.15.33:0/1063068370 conn(0x7fbea006e170 msgr2=0x7fbea0069930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 shutdown_connections 2024-08-15T17:54:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.823+0000 7fbe9ffff700 1 -- 172.21.15.33:0/1063068370 wait complete. 2024-08-15T17:54:18.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:18.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ec5b6700 1 Processor -- start 2024-08-15T17:54:18.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ec5b6700 1 -- start start 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ec5b6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb8e40cc160 0x7fb8e40c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ec5b6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40c7750 con 0x7fb8e40688d0 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ec5b6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40c6e20 con 0x7fb8e4068ca0 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ec5b6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40cb220 con 0x7fb8e40cc160 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ea352700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb8e40688d0 0x7fb8e40caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42378/0 (socket says 172.21.15.33:42378) 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8ea352700 1 -- 172.21.15.33:0/697049656 learned_addr learned my addr 172.21.15.33:0/697049656 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:18.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8eab53700 1 --2- 172.21.15.33:0/697049656 >> v2:172.21.15.105:3300/0 conn(0x7fb8e40cc160 0x7fb8e40c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291381491 0 0) 0x7fb8e40c7750 con 0x7fb8e40688d0 2024-08-15T17:54:18.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.947+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d0003570 con 0x7fb8e40688d0 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393511598 0 0) 0x7fb8e40c6e20 con 0x7fb8e4068ca0 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e40c7750 con 0x7fb8e4068ca0 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8eab53700 1 -- 172.21.15.33:0/697049656 >> v1:172.21.15.105:6789/0 conn(0x7fb8e4068ca0 legacy=0x7fb8e406a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8eab53700 1 -- 172.21.15.33:0/697049656 >> v1:172.21.15.33:6789/0 conn(0x7fb8e40688d0 legacy=0x7fb8e40caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8eab53700 1 -- 172.21.15.33:0/697049656 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40c7100 con 0x7fb8e40cc160 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8eab53700 1 --2- 172.21.15.33:0/697049656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e40cc160 0x7fb8e40c7be0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009e60 tx=0x7fb8dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a858e3f226710b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00e070 con 0x7fb8e40cc160 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00bab0 con 0x7fb8e40cc160 2024-08-15T17:54:18.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8e9350700 1 -- 172.21.15.33:0/697049656 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00be30 con 0x7fb8e40cc160 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/697049656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e40cc160 msgr2=0x7fb8e40c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/697049656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e40cc160 0x7fb8e40c7be0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009e60 tx=0x7fb8dc009780 comp rx=0 tx=0).stop 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/697049656 shutdown_connections 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/697049656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e40cc160 0x7fb8e40c7be0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/697049656 >> 172.21.15.33:0/697049656 conn(0x7fb8e40c9c20 msgr2=0x7fb8e406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/697049656 shutdown_connections 2024-08-15T17:54:18.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.951+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/697049656 wait complete. 2024-08-15T17:54:18.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 Processor -- start 2024-08-15T17:54:18.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 -- start start 2024-08-15T17:54:18.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 0x7fb8e40c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e4068ca0 0x7fb8e4067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8e40cc160 0x7fb8e40c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40c5d90 con 0x7fb8e40688d0 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40c6560 con 0x7fb8e4068ca0 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ec5b6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4155d50 con 0x7fb8e40cc160 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 0x7fb8e40c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 0x7fb8e40c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46466/0 (socket says 172.21.15.33:46466) 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 -- 172.21.15.33:0/1234189619 learned_addr learned my addr 172.21.15.33:0/1234189619 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8eab53700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8e40cc160 0x7fb8e40c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8e9b51700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e4068ca0 0x7fb8e4067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 -- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8e40cc160 msgr2=0x7fb8e40c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8e40cc160 0x7fb8e40c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 -- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e4068ca0 msgr2=0x7fb8e4067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e4068ca0 0x7fb8e4067920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.955+0000 7fb8ea352700 1 -- 172.21.15.33:0/1234189619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc009a20 con 0x7fb8e40688d0 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8ea352700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 0x7fb8e40c5630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c790 tx=0x7fb8e0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0005b30 con 0x7fb8e40688d0 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e0005c90 con 0x7fb8e40688d0 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e40c5b70 con 0x7fb8e40688d0 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0007300 con 0x7fb8e40688d0 2024-08-15T17:54:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e40c6280 con 0x7fb8e40688d0 2024-08-15T17:54:18.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e40645c0 con 0x7fb8e40688d0 2024-08-15T17:54:18.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb8e001b3b0 con 0x7fb8e40688d0 2024-08-15T17:54:18.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8da7fc700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb8c8060890 0x7fb8c8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:18.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.959+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8e007c020 con 0x7fb8e40688d0 2024-08-15T17:54:18.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.963+0000 7fb8e9b51700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb8c8060890 0x7fb8c8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:18.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.963+0000 7fb8e9b51700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb8c8060890 0x7fb8c8062d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8e406c5c0 tx=0x7fb8d4007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:18.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:18.971+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb8e004ff00 con 0x7fb8e40688d0 2024-08-15T17:54:19.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.135+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8e40caeb0 con 0x7fb8e40688d0 2024-08-15T17:54:19.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.135+0000 7fb8da7fc700 1 -- 172.21.15.33:0/1234189619 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb8e0017090 con 0x7fb8e40688d0 2024-08-15T17:54:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:19.138 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb8c8060890 msgr2=0x7fb8c8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb8c8060890 0x7fb8c8062d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8e406c5c0 tx=0x7fb8d4007d50 comp rx=0 tx=0).stop 2024-08-15T17:54:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 msgr2=0x7fb8e40c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 0x7fb8e40c5630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c790 tx=0x7fb8e0007ea0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 shutdown_connections 2024-08-15T17:54:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb8c8060890 0x7fb8c8062d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8e4068ca0 0x7fb8e4067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8e40cc160 0x7fb8e40c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 --2- 172.21.15.33:0/1234189619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e40688d0 0x7fb8e40c5630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 >> 172.21.15.33:0/1234189619 conn(0x7fb8e40c9c20 msgr2=0x7fb8e406a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 shutdown_connections 2024-08-15T17:54:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.139+0000 7fb8ec5b6700 1 -- 172.21.15.33:0/1234189619 wait complete. 2024-08-15T17:54:19.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:19.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4686449700 1 Processor -- start 2024-08-15T17:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4686449700 1 -- start start 2024-08-15T17:54:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4686449700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f46800b0ea0 0x7f46800b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4686449700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4680068dd0 con 0x7f46800b33c0 2024-08-15T17:54:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4686449700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800b3d60 con 0x7f46800ae8e0 2024-08-15T17:54:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4686449700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46800b3800 con 0x7f46800b0ea0 2024-08-15T17:54:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4685c48700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f46800b33c0 0x7f4680069260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42394/0 (socket says 172.21.15.33:42394) 2024-08-15T17:54:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.267+0000 7f4685c48700 1 -- 172.21.15.33:0/3076893111 learned_addr learned my addr 172.21.15.33:0/3076893111 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4685447700 1 --2- 172.21.15.33:0/3076893111 >> v2:172.21.15.105:3300/0 conn(0x7f46800b0ea0 0x7f46800b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878984013 0 0) 0x7f4680068dd0 con 0x7f46800b33c0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c003570 con 0x7f46800b33c0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959833032 0 0) 0x7f46800b3d60 con 0x7f46800ae8e0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4680068dd0 con 0x7f46800ae8e0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4685447700 1 -- 172.21.15.33:0/3076893111 >> v1:172.21.15.105:6789/0 conn(0x7f46800ae8e0 legacy=0x7f46800b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4685447700 1 -- 172.21.15.33:0/3076893111 >> v1:172.21.15.33:6789/0 conn(0x7f46800b33c0 legacy=0x7f4680069260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4685447700 1 -- 172.21.15.33:0/3076893111 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800aed30 con 0x7f46800b0ea0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4685447700 1 --2- 172.21.15.33:0/3076893111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f46800b1270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f467c0098e0 tx=0x7f467c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2ecab195401f81 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011630 con 0x7f46800b0ea0 2024-08-15T17:54:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c011790 con 0x7f46800b0ea0 2024-08-15T17:54:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4673fff700 1 -- 172.21.15.33:0/3076893111 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011b30 con 0x7f46800b0ea0 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 -- 172.21.15.33:0/3076893111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 msgr2=0x7f46800b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 --2- 172.21.15.33:0/3076893111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f46800b1270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f467c0098e0 tx=0x7f467c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 -- 172.21.15.33:0/3076893111 shutdown_connections 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 --2- 172.21.15.33:0/3076893111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f46800b1270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 -- 172.21.15.33:0/3076893111 >> 172.21.15.33:0/3076893111 conn(0x7f46800ce920 msgr2=0x7f468006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 -- 172.21.15.33:0/3076893111 shutdown_connections 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 -- 172.21.15.33:0/3076893111 wait complete. 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 Processor -- start 2024-08-15T17:54:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.271+0000 7f4686449700 1 -- start start 2024-08-15T17:54:19.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46800ae8e0 0x7f4680169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f468013e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 0x7f46800c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800ca4a0 con 0x7f46800b33c0 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800c7fb0 con 0x7f46800b0ea0 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468016a130 con 0x7f46800ae8e0 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 0x7f46800c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 0x7f46800c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46478/0 (socket says 172.21.15.33:46478) 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 -- 172.21.15.33:0/2065241966 learned_addr learned my addr 172.21.15.33:0/2065241966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685447700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46800ae8e0 0x7f4680169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4684c46700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f468013e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 -- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46800ae8e0 msgr2=0x7f4680169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46800ae8e0 0x7f4680169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 -- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 msgr2=0x7f468013e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f468013e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 -- 172.21.15.33:0/2065241966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009420 con 0x7f46800b33c0 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4685c48700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 0x7f46800c94d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f467800cc20 tx=0x7f4678001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800a850 con 0x7f46800b33c0 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800a9b0 con 0x7f46800b33c0 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468013ee50 con 0x7f46800b33c0 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800ad30 con 0x7f46800b33c0 2024-08-15T17:54:19.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468006ab00 con 0x7f46800b33c0 2024-08-15T17:54:19.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.275+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4680064330 con 0x7f46800b33c0 2024-08-15T17:54:19.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.279+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4678007300 con 0x7f46800b33c0 2024-08-15T17:54:19.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.279+0000 7f46717fa700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4664060860 0x7f4664062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.279+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f467807d8a0 con 0x7f46800b33c0 2024-08-15T17:54:19.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.279+0000 7f4685447700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4664060860 0x7f4664062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.279+0000 7f4685447700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4664060860 0x7f4664062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f467c0093f0 tx=0x7f467c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.287+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f467804de50 con 0x7f46800b33c0 2024-08-15T17:54:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.455+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46800cedb0 con 0x7f46800b33c0 2024-08-15T17:54:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.455+0000 7f46717fa700 1 -- 172.21.15.33:0/2065241966 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4678051470 con 0x7f46800b33c0 2024-08-15T17:54:19.456 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.455+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4664060860 msgr2=0x7f4664062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.455+0000 7f4686449700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4664060860 0x7f4664062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f467c0093f0 tx=0x7f467c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.455+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 msgr2=0x7f46800c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.455+0000 7f4686449700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 0x7f46800c94d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f467800cc20 tx=0x7f4678001a40 comp rx=0 tx=0).stop 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 shutdown_connections 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4664060860 0x7f4664062d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b0ea0 0x7f468013e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46800b33c0 0x7f46800c94d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 --2- 172.21.15.33:0/2065241966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46800ae8e0 0x7f4680169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 >> 172.21.15.33:0/2065241966 conn(0x7f46800ce920 msgr2=0x7f4680141c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 shutdown_connections 2024-08-15T17:54:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.459+0000 7f4686449700 1 -- 172.21.15.33:0/2065241966 wait complete. 2024-08-15T17:54:19.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:19.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 Processor -- start 2024-08-15T17:54:19.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 -- start start 2024-08-15T17:54:19.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ab0159240 0x7f6ab00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab00c9280 0x7f6ab00caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00add80 con 0x7f6ab00c83f0 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00adfb0 con 0x7f6ab0159240 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6ab538d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00ae290 con 0x7f6ab00c9280 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aa67fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ab00c83f0 0x7f6ab00c8b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42400/0 (socket says 172.21.15.33:42400) 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aa67fc700 1 -- 172.21.15.33:0/1933583107 learned_addr learned my addr 172.21.15.33:0/1933583107 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaeffd700 1 --2- 172.21.15.33:0/1933583107 >> v2:172.21.15.105:3300/0 conn(0x7f6ab0159240 0x7f6ab00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaf7fe700 1 --2- 172.21.15.33:0/1933583107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab00c9280 0x7f6ab00caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aae7fc700 1 -- 172.21.15.33:0/1933583107 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658643223 0 0) 0x7f6ab00add80 con 0x7f6ab00c83f0 2024-08-15T17:54:19.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aae7fc700 1 -- 172.21.15.33:0/1933583107 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c003570 con 0x7f6ab00c83f0 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aae7fc700 1 -- 172.21.15.33:0/1933583107 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1538825517 0 0) 0x7f6a9c003570 con 0x7f6ab00c83f0 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaf7fe700 1 -- 172.21.15.33:0/1933583107 >> v2:172.21.15.105:3300/0 conn(0x7f6ab0159240 msgr2=0x7f6ab00c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaf7fe700 1 --2- 172.21.15.33:0/1933583107 >> v2:172.21.15.105:3300/0 conn(0x7f6ab0159240 0x7f6ab00c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaf7fe700 1 -- 172.21.15.33:0/1933583107 >> v1:172.21.15.33:6789/0 conn(0x7f6ab00c83f0 legacy=0x7f6ab00c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaf7fe700 1 -- 172.21.15.33:0/1933583107 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00ae570 con 0x7f6ab00c9280 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.583+0000 7f6aaeffd700 1 --2- 172.21.15.33:0/1933583107 >> v2:172.21.15.105:3300/0 conn(0x7f6ab0159240 0x7f6ab00c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6aaf7fe700 1 --2- 172.21.15.33:0/1933583107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab00c9280 0x7f6ab00caa60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009e60 tx=0x7f6aa8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ec003edc5ac1df server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6aae7fc700 1 -- 172.21.15.33:0/1933583107 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800e070 con 0x7f6ab00c9280 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6aae7fc700 1 -- 172.21.15.33:0/1933583107 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800b7a0 con 0x7f6ab00c9280 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6aae7fc700 1 -- 172.21.15.33:0/1933583107 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98001470 con 0x7f6ab00c9280 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 -- 172.21.15.33:0/1933583107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab00c9280 msgr2=0x7f6ab00caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 --2- 172.21.15.33:0/1933583107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab00c9280 0x7f6ab00caa60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009e60 tx=0x7f6aa8009780 comp rx=0 tx=0).stop 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 -- 172.21.15.33:0/1933583107 shutdown_connections 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 --2- 172.21.15.33:0/1933583107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab00c9280 0x7f6ab00caa60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 --2- 172.21.15.33:0/1933583107 >> v2:172.21.15.105:3300/0 conn(0x7f6ab0159240 0x7f6ab00c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 -- 172.21.15.33:0/1933583107 >> 172.21.15.33:0/1933583107 conn(0x7f6ab00cd9c0 msgr2=0x7f6ab00c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:19.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 -- 172.21.15.33:0/1933583107 shutdown_connections 2024-08-15T17:54:19.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 -- 172.21.15.33:0/1933583107 wait complete. 2024-08-15T17:54:19.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.587+0000 7f6ab538d700 1 Processor -- start 2024-08-15T17:54:19.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 -- start start 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 0x7f6ab00ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ab00c9280 0x7f6ab00ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab0159240 0x7f6ab00c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c6ef0 con 0x7f6ab00c83f0 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c6370 con 0x7f6ab00c9280 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c6650 con 0x7f6ab0159240 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 0x7f6ab00ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 0x7f6ab00ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46482/0 (socket says 172.21.15.33:46482) 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 -- 172.21.15.33:0/3208035937 learned_addr learned my addr 172.21.15.33:0/3208035937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aa67fc700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ab00c9280 0x7f6ab00ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaf7fe700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab0159240 0x7f6ab00c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 -- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab0159240 msgr2=0x7f6ab00c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab0159240 0x7f6ab00c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 -- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ab00c9280 msgr2=0x7f6ab00ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ab00c9280 0x7f6ab00ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 -- 172.21.15.33:0/3208035937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0009420 con 0x7f6ab00c83f0 2024-08-15T17:54:19.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aaeffd700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 0x7f6ab00ab890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000ec80 tx=0x7f6aa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000c920 con 0x7f6ab00c83f0 2024-08-15T17:54:19.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa000ca80 con 0x7f6ab00c83f0 2024-08-15T17:54:19.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa8009a20 con 0x7f6ab00c83f0 2024-08-15T17:54:19.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000ce00 con 0x7f6ab00c83f0 2024-08-15T17:54:19.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.591+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab00c6c10 con 0x7f6ab00c83f0 2024-08-15T17:54:19.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.595+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab00645c0 con 0x7f6ab00c83f0 2024-08-15T17:54:19.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.595+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6aa0013680 con 0x7f6ab00c83f0 2024-08-15T17:54:19.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.595+0000 7f6aa77fe700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6a90060860 0x7f6a90062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.595+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6aa007d2f0 con 0x7f6ab00c83f0 2024-08-15T17:54:19.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.595+0000 7f6aa67fc700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6a90060860 0x7f6a90062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.599+0000 7f6aa67fc700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6a90060860 0x7f6a90062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00c5150 tx=0x7f6a98001a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.603+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6aa004d740 con 0x7f6ab00c83f0 2024-08-15T17:54:19.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ab00cc790 con 0x7f6ab00c83f0 2024-08-15T17:54:19.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6aa77fe700 1 -- 172.21.15.33:0/3208035937 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6aa0050d60 con 0x7f6ab00c83f0 2024-08-15T17:54:19.768 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:19.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6a90060860 msgr2=0x7f6a90062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6a90060860 0x7f6a90062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00c5150 tx=0x7f6a98001a00 comp rx=0 tx=0).stop 2024-08-15T17:54:19.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 msgr2=0x7f6ab00ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 0x7f6ab00ab890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000ec80 tx=0x7f6aa00091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 shutdown_connections 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6a90060860 0x7f6a90062d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ab00c9280 0x7f6ab00ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ab0159240 0x7f6ab00c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 --2- 172.21.15.33:0/3208035937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab00c83f0 0x7f6ab00ab890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 >> 172.21.15.33:0/3208035937 conn(0x7f6ab00cd9c0 msgr2=0x7f6ab00cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.767+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 shutdown_connections 2024-08-15T17:54:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.771+0000 7f6ab538d700 1 -- 172.21.15.33:0/3208035937 wait complete. 2024-08-15T17:54:19.782 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.895+0000 7f43b5aeb700 1 Processor -- start 2024-08-15T17:54:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.895+0000 7f43b5aeb700 1 -- start start 2024-08-15T17:54:19.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b00b1180 con 0x7f43b00aec20 2024-08-15T17:54:19.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b00b0890 con 0x7f43b0142660 2024-08-15T17:54:19.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00c9310 con 0x7f43b00b2620 2024-08-15T17:54:19.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43affff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f43b00aec20 0x7f43b00c82e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42414/0 (socket says 172.21.15.33:42414) 2024-08-15T17:54:19.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43affff700 1 -- 172.21.15.33:0/541409144 learned_addr learned my addr 172.21.15.33:0/541409144 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:19.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b52ea700 1 --2- 172.21.15.33:0/541409144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43af7fe700 1 -- 172.21.15.33:0/541409144 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826150348 0 0) 0x7f43b00b1180 con 0x7f43b00aec20 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b52ea700 1 -- 172.21.15.33:0/541409144 >> v1:172.21.15.105:6789/0 conn(0x7f43b0142660 legacy=0x7f43b00ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b52ea700 1 -- 172.21.15.33:0/541409144 >> v1:172.21.15.33:6789/0 conn(0x7f43b00aec20 legacy=0x7f43b00c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b52ea700 1 -- 172.21.15.33:0/541409144 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00c9030 con 0x7f43b00b2620 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b52ea700 1 --2- 172.21.15.33:0/541409144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b0142a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009e90 tx=0x7f43a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f2337f545d87e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43af7fe700 1 -- 172.21.15.33:0/541409144 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800e070 con 0x7f43b00b2620 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43af7fe700 1 -- 172.21.15.33:0/541409144 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800bc30 con 0x7f43b00b2620 2024-08-15T17:54:19.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43af7fe700 1 -- 172.21.15.33:0/541409144 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8012430 con 0x7f43b00b2620 2024-08-15T17:54:19.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 -- 172.21.15.33:0/541409144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 msgr2=0x7f43b0142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/541409144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b0142a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009e90 tx=0x7f43a8009780 comp rx=0 tx=0).stop 2024-08-15T17:54:19.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 -- 172.21.15.33:0/541409144 shutdown_connections 2024-08-15T17:54:19.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/541409144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b0142a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.899+0000 7f43b5aeb700 1 -- 172.21.15.33:0/541409144 >> 172.21.15.33:0/541409144 conn(0x7f43b00c9830 msgr2=0x7f43b00c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:19.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.903+0000 7f43b5aeb700 1 -- 172.21.15.33:0/541409144 shutdown_connections 2024-08-15T17:54:19.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.903+0000 7f43b5aeb700 1 -- 172.21.15.33:0/541409144 wait complete. 2024-08-15T17:54:19.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.903+0000 7f43b5aeb700 1 Processor -- start 2024-08-15T17:54:19.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.903+0000 7f43b5aeb700 1 -- start start 2024-08-15T17:54:19.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.903+0000 7f43b5aeb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 0x7f43b0157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.903+0000 7f43b5aeb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b016c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b5aeb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 0x7f43b013d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b5aeb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b013b220 con 0x7f43b00aec20 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b5aeb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b013b770 con 0x7f43b0142660 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b5aeb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b016d440 con 0x7f43b00b2620 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 0x7f43b0157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b52ea700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 0x7f43b013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43affff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b016c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 0x7f43b0157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46484/0 (socket says 172.21.15.33:46484) 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b52ea700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 0x7f43b013d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55240/0 (socket says 172.21.15.33:55240) 2024-08-15T17:54:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b52ea700 1 -- 172.21.15.33:0/1746575831 learned_addr learned my addr 172.21.15.33:0/1746575831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:19.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 -- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 msgr2=0x7f43b016c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b016c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 -- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 msgr2=0x7f43b013d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 0x7f43b013d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 -- 172.21.15.33:0/1746575831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009a20 con 0x7f43b00aec20 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b52ea700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 0x7f43b013d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b4ae9700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 0x7f43b0157f60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c490 tx=0x7f43a4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400ce40 con 0x7f43b00aec20 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b016d720 con 0x7f43b00aec20 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4011590 con 0x7f43b00aec20 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4011950 con 0x7f43b00aec20 2024-08-15T17:54:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.907+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b0158a90 con 0x7f43b00aec20 2024-08-15T17:54:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.911+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f43a4011cc0 con 0x7f43b00aec20 2024-08-15T17:54:19.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.911+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b00638f0 con 0x7f43b00aec20 2024-08-15T17:54:19.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.911+0000 7f43acff9700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4394060860 0x7f4394062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:19.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.911+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43a407bfa0 con 0x7f43b00aec20 2024-08-15T17:54:19.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.911+0000 7f43affff700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4394060860 0x7f4394062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:19.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.911+0000 7f43affff700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4394060860 0x7f4394062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43b013e740 tx=0x7f439c007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:19.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:19.919+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f43a404c350 con 0x7f43b00aec20 2024-08-15T17:54:20.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.079+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43b0141d40 con 0x7f43b00aec20 2024-08-15T17:54:20.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43acff9700 1 -- 172.21.15.33:0/1746575831 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43a40170a0 con 0x7f43b00aec20 2024-08-15T17:54:20.083 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4394060860 msgr2=0x7f4394062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4394060860 0x7f4394062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43b013e740 tx=0x7f439c007d10 comp rx=0 tx=0).stop 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 msgr2=0x7f43b0157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 0x7f43b0157f60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c490 tx=0x7f43a4007ec0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 shutdown_connections 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4394060860 0x7f4394062d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43b0142660 0x7f43b013d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43b00b2620 0x7f43b016c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 --2- 172.21.15.33:0/1746575831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43b00aec20 0x7f43b0157f60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 >> 172.21.15.33:0/1746575831 conn(0x7f43b00c9830 msgr2=0x7f43b006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 shutdown_connections 2024-08-15T17:54:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.083+0000 7f43b5aeb700 1 -- 172.21.15.33:0/1746575831 wait complete. 2024-08-15T17:54:20.097 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:20.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 Processor -- start 2024-08-15T17:54:20.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 -- start start 2024-08-15T17:54:20.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ed0158780 0x7f3ed01558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00aff80 con 0x7f3ed006e320 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00af0d0 con 0x7f3ed0158780 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed63ff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00af370 con 0x7f3ed00a9550 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecf7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3ed006e320 0x7f3ed00a8e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42424/0 (socket says 172.21.15.33:42424) 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecf7fe700 1 -- 172.21.15.33:0/1306725122 learned_addr learned my addr 172.21.15.33:0/1306725122 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecffff700 1 --2- 172.21.15.33:0/1306725122 >> v2:172.21.15.105:3300/0 conn(0x7f3ed0158780 0x7f3ed01558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed499c700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3eceffd700 1 -- 172.21.15.33:0/1306725122 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754085256 0 0) 0x7f3ed00aff80 con 0x7f3ed006e320 2024-08-15T17:54:20.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3eceffd700 1 -- 172.21.15.33:0/1306725122 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb8003570 con 0x7f3ed006e320 2024-08-15T17:54:20.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecffff700 1 -- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 msgr2=0x7f3ed006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:20.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecffff700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecffff700 1 -- 172.21.15.33:0/1306725122 >> v1:172.21.15.33:6789/0 conn(0x7f3ed006e320 legacy=0x7f3ed00a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecffff700 1 -- 172.21.15.33:0/1306725122 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00af650 con 0x7f3ed0158780 2024-08-15T17:54:20.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ed499c700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:20.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.203+0000 7f3ecffff700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed0158780 0x7f3ed01558b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00098e0 tx=0x7f3ec00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a30730074daa2b70 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3eceffd700 1 -- 172.21.15.33:0/1306725122 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011630 con 0x7f3ed0158780 2024-08-15T17:54:20.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3eceffd700 1 -- 172.21.15.33:0/1306725122 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0011790 con 0x7f3ed0158780 2024-08-15T17:54:20.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3eceffd700 1 -- 172.21.15.33:0/1306725122 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011b30 con 0x7f3ed0158780 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 -- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed0158780 msgr2=0x7f3ed01558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed0158780 0x7f3ed01558b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00098e0 tx=0x7f3ec00091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 -- 172.21.15.33:0/1306725122 shutdown_connections 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/1306725122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed0158780 0x7f3ed01558b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 -- 172.21.15.33:0/1306725122 >> 172.21.15.33:0/1306725122 conn(0x7f3ed0066e00 msgr2=0x7f3ed0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 -- 172.21.15.33:0/1306725122 shutdown_connections 2024-08-15T17:54:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 -- 172.21.15.33:0/1306725122 wait complete. 2024-08-15T17:54:20.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 Processor -- start 2024-08-15T17:54:20.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.207+0000 7f3ed63ff700 1 -- start start 2024-08-15T17:54:20.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed006e320 0x7f3ed0098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed00ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 0x7f3ed014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00ac4d0 con 0x7f3ed0158780 2024-08-15T17:54:20.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00ab920 con 0x7f3ed006e320 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00abba0 con 0x7f3ed00a9550 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 0x7f3ed014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 0x7f3ed014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46500/0 (socket says 172.21.15.33:46500) 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 -- 172.21.15.33:0/2830262037 learned_addr learned my addr 172.21.15.33:0/2830262037 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ecffff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed006e320 0x7f3ed0098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ecf7fe700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed00ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 -- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 msgr2=0x7f3ed00ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed00ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 -- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed006e320 msgr2=0x7f3ed0098c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed006e320 0x7f3ed0098c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 -- 172.21.15.33:0/2830262037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec8009a20 con 0x7f3ed0158780 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ecf7fe700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:20.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed499c700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 0x7f3ed014eef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c0f0 tx=0x7f3ec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800cce0 con 0x7f3ed0158780 2024-08-15T17:54:20.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec800f040 con 0x7f3ed0158780 2024-08-15T17:54:20.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80146d0 con 0x7f3ed0158780 2024-08-15T17:54:20.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec0009420 con 0x7f3ed0158780 2024-08-15T17:54:20.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00ac160 con 0x7f3ed0158780 2024-08-15T17:54:20.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed00ac680 con 0x7f3ed0158780 2024-08-15T17:54:20.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.211+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3ec8003020 con 0x7f3ed0158780 2024-08-15T17:54:20.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.215+0000 7f3eb7fff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ebc060860 0x7f3ebc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.215+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ec807d540 con 0x7f3ed0158780 2024-08-15T17:54:20.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.215+0000 7f3ecffff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ebc060860 0x7f3ebc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.215+0000 7f3ecffff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ebc060860 0x7f3ebc062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00091e0 tx=0x7f3ec0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.223+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3ed00ac680 con 0x7f3ed0158780 2024-08-15T17:54:20.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.387+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ed00ac680 con 0x7f3ed0158780 2024-08-15T17:54:20.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3eb7fff700 1 -- 172.21.15.33:0/2830262037 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f3ec8066e60 con 0x7f3ed0158780 2024-08-15T17:54:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:20.392 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ebc060860 msgr2=0x7f3ebc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ebc060860 0x7f3ebc062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00091e0 tx=0x7f3ec0017000 comp rx=0 tx=0).stop 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 msgr2=0x7f3ed014eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 0x7f3ed014eef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c0f0 tx=0x7f3ec800b040 comp rx=0 tx=0).stop 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 shutdown_connections 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3ebc060860 0x7f3ebc062d10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed0158780 0x7f3ed014eef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ed00a9550 0x7f3ed00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 --2- 172.21.15.33:0/2830262037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed006e320 0x7f3ed0098c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 >> 172.21.15.33:0/2830262037 conn(0x7f3ed0066e00 msgr2=0x7f3ed006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 shutdown_connections 2024-08-15T17:54:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.391+0000 7f3ed63ff700 1 -- 172.21.15.33:0/2830262037 wait complete. 2024-08-15T17:54:20.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:20.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 Processor -- start 2024-08-15T17:54:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 -- start start 2024-08-15T17:54:20.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35380adef0 0x7f35380ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3538158cb0 0x7f35381552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380ae800 con 0x7f3538158840 2024-08-15T17:54:20.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3538159190 con 0x7f3538158cb0 2024-08-15T17:54:20.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f353d6c0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3538159470 con 0x7f35380adef0 2024-08-15T17:54:20.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f35367fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3538158840 0x7f353815a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42428/0 (socket says 172.21.15.33:42428) 2024-08-15T17:54:20.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f35367fc700 1 -- 172.21.15.33:0/1008595651 learned_addr learned my addr 172.21.15.33:0/1008595651 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:20.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3536ffd700 1 --2- 172.21.15.33:0/1008595651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35380adef0 0x7f35380ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f35377fe700 1 --2- 172.21.15.33:0/1008595651 >> v2:172.21.15.105:3300/0 conn(0x7f3538158cb0 0x7f35381552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3535ffb700 1 -- 172.21.15.33:0/1008595651 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936030999 0 0) 0x7f35380ae800 con 0x7f3538158840 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3535ffb700 1 -- 172.21.15.33:0/1008595651 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003570 con 0x7f3538158840 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3536ffd700 1 -- 172.21.15.33:0/1008595651 >> v2:172.21.15.105:3300/0 conn(0x7f3538158cb0 msgr2=0x7f35381552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3536ffd700 1 --2- 172.21.15.33:0/1008595651 >> v2:172.21.15.105:3300/0 conn(0x7f3538158cb0 0x7f35381552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3536ffd700 1 -- 172.21.15.33:0/1008595651 >> v1:172.21.15.33:6789/0 conn(0x7f3538158840 legacy=0x7f353815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3536ffd700 1 -- 172.21.15.33:0/1008595651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538159750 con 0x7f35380adef0 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.519+0000 7f3536ffd700 1 --2- 172.21.15.33:0/1008595651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35380adef0 0x7f35380ae2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f35280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133e805c8bc0c5a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f3535ffb700 1 -- 172.21.15.33:0/1008595651 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011630 con 0x7f35380adef0 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f3535ffb700 1 -- 172.21.15.33:0/1008595651 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528011790 con 0x7f35380adef0 2024-08-15T17:54:20.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f3535ffb700 1 -- 172.21.15.33:0/1008595651 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011b10 con 0x7f35380adef0 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 -- 172.21.15.33:0/1008595651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35380adef0 msgr2=0x7f35380ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 --2- 172.21.15.33:0/1008595651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35380adef0 0x7f35380ae2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f35280091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 -- 172.21.15.33:0/1008595651 shutdown_connections 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 --2- 172.21.15.33:0/1008595651 >> v2:172.21.15.105:3300/0 conn(0x7f3538158cb0 0x7f35381552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 --2- 172.21.15.33:0/1008595651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35380adef0 0x7f35380ae2c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 -- 172.21.15.33:0/1008595651 >> 172.21.15.33:0/1008595651 conn(0x7f35380cd9c0 msgr2=0x7f35380c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 -- 172.21.15.33:0/1008595651 shutdown_connections 2024-08-15T17:54:20.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 -- 172.21.15.33:0/1008595651 wait complete. 2024-08-15T17:54:20.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 Processor -- start 2024-08-15T17:54:20.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 -- start start 2024-08-15T17:54:20.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 0x7f3538069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3538158840 0x7f35380c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.523+0000 7f353d6c0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3538158cb0 0x7f3538169510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f353d6c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538166f80 con 0x7f35380adef0 2024-08-15T17:54:20.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f353d6c0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353814cff0 con 0x7f3538158cb0 2024-08-15T17:54:20.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f353d6c0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380c9270 con 0x7f3538158840 2024-08-15T17:54:20.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 0x7f3538069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 0x7f3538069580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46512/0 (socket says 172.21.15.33:46512) 2024-08-15T17:54:20.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 -- 172.21.15.33:0/2325207184 learned_addr learned my addr 172.21.15.33:0/2325207184 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:20.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f35377fe700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3538158cb0 0x7f3538169510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f35367fc700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3538158840 0x7f35380c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 -- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3538158840 msgr2=0x7f35380c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3538158840 0x7f35380c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 -- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3538158cb0 msgr2=0x7f3538169510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3538158cb0 0x7f3538169510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 -- 172.21.15.33:0/2325207184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009420 con 0x7f35380adef0 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f35367fc700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3538158840 0x7f35380c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f35377fe700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3538158cb0 0x7f3538169510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f3536ffd700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 0x7f3538069580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35380ada80 tx=0x7f3528017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011b10 con 0x7f35380adef0 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528000d10 con 0x7f35380adef0 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35380c9520 con 0x7f35380adef0 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801a660 con 0x7f35380adef0 2024-08-15T17:54:20.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35380c9ae0 con 0x7f35380adef0 2024-08-15T17:54:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380645c0 con 0x7f35380adef0 2024-08-15T17:54:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.527+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f352801aa90 con 0x7f35380adef0 2024-08-15T17:54:20.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.531+0000 7f352effd700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f351c060890 0x7f351c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.531+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f352807e660 con 0x7f35380adef0 2024-08-15T17:54:20.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.531+0000 7f35367fc700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f351c060890 0x7f351c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.531+0000 7f35367fc700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f351c060890 0x7f351c062d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35200058d0 tx=0x7f3520009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.539+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f352804eab0 con 0x7f35380adef0 2024-08-15T17:54:20.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.703+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35380c2520 con 0x7f35380adef0 2024-08-15T17:54:20.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.703+0000 7f352effd700 1 -- 172.21.15.33:0/2325207184 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35280520d0 con 0x7f35380adef0 2024-08-15T17:54:20.705 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f351c060890 msgr2=0x7f351c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f351c060890 0x7f351c062d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35200058d0 tx=0x7f3520009040 comp rx=0 tx=0).stop 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 msgr2=0x7f3538069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 0x7f3538069580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35380ada80 tx=0x7f3528017000 comp rx=0 tx=0).stop 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 shutdown_connections 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f351c060890 0x7f351c062d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3538158cb0 0x7f3538169510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3538158840 0x7f35380c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 --2- 172.21.15.33:0/2325207184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35380adef0 0x7f3538069580 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 >> 172.21.15.33:0/2325207184 conn(0x7f35380cd9c0 msgr2=0x7f35380b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:20.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 shutdown_connections 2024-08-15T17:54:20.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.707+0000 7f353d6c0700 1 -- 172.21.15.33:0/2325207184 wait complete. 2024-08-15T17:54:20.720 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:20.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 Processor -- start 2024-08-15T17:54:20.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 -- start start 2024-08-15T17:54:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f57f013f680 0x7f57f00aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f013fa50 0x7f57f00ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00afc70 con 0x7f57f00b0100 2024-08-15T17:54:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f00adc00 con 0x7f57f013f680 2024-08-15T17:54:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57effff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00af060 con 0x7f57f013fa50 2024-08-15T17:54:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57ee7fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f013fa50 0x7f57f00ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f57f013f680 0x7f57f00aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f57f013f680 0x7f57f00aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55280/0 (socket says 172.21.15.33:55280) 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 -- 172.21.15.33:0/1770871860 learned_addr learned my addr 172.21.15.33:0/1770871860 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57ee7fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f013fa50 0x7f57f00ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:52560/0 (socket says 172.21.15.33:52560) 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 -- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f013fa50 msgr2=0x7f57f00ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 --2- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f013fa50 0x7f57f00ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 -- 172.21.15.33:0/1770871860 >> v1:172.21.15.105:6789/0 conn(0x7f57f00b0100 legacy=0x7f57f006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.839+0000 7f57eeffd700 1 -- 172.21.15.33:0/1770871860 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00af340 con 0x7f57f013f680 2024-08-15T17:54:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57eeffd700 1 --2- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013f680 0x7f57f00aea80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009f20 tx=0x7f57e8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd55faa4ba20b8b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57edffb700 1 -- 172.21.15.33:0/1770871860 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800e070 con 0x7f57f013f680 2024-08-15T17:54:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57edffb700 1 -- 172.21.15.33:0/1770871860 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e800b9d0 con 0x7f57f013f680 2024-08-15T17:54:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57edffb700 1 -- 172.21.15.33:0/1770871860 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80092e0 con 0x7f57f013f680 2024-08-15T17:54:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013f680 msgr2=0x7f57f00aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 --2- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013f680 0x7f57f00aea80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009f20 tx=0x7f57e8009840 comp rx=0 tx=0).stop 2024-08-15T17:54:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- 172.21.15.33:0/1770871860 shutdown_connections 2024-08-15T17:54:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 --2- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f013fa50 0x7f57f00ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 --2- 172.21.15.33:0/1770871860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013f680 0x7f57f00aea80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- 172.21.15.33:0/1770871860 >> 172.21.15.33:0/1770871860 conn(0x7f57f00678a0 msgr2=0x7f57f0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- 172.21.15.33:0/1770871860 shutdown_connections 2024-08-15T17:54:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- 172.21.15.33:0/1770871860 wait complete. 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 Processor -- start 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- start start 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f00b0100 0x7f57f0150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 0x7f57f00ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013fa50 0x7f57f00a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00ab420 con 0x7f57f013f680 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0151480 con 0x7f57f013fa50 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.843+0000 7f57effff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00a5820 con 0x7f57f00b0100 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 0x7f57f00ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57eeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f00b0100 0x7f57f0150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 0x7f57f00ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46522/0 (socket says 172.21.15.33:46522) 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57eeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f00b0100 0x7f57f0150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:52574/0 (socket says 172.21.15.33:52574) 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 -- 172.21.15.33:0/3785891840 learned_addr learned my addr 172.21.15.33:0/3785891840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ef7fe700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013fa50 0x7f57f00a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 -- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f00b0100 msgr2=0x7f57f0150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f00b0100 0x7f57f0150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 -- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013fa50 msgr2=0x7f57f00a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013fa50 0x7f57f00a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 -- 172.21.15.33:0/3785891840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8009ae0 con 0x7f57f013f680 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ef7fe700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013fa50 0x7f57f00a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57ee7fc700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 0x7f57f00ab810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e900 tx=0x7f57d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8013680 con 0x7f57f013f680 2024-08-15T17:54:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80137e0 con 0x7f57f013f680 2024-08-15T17:54:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f014e5d0 con 0x7f57f013f680 2024-08-15T17:54:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8013ba0 con 0x7f57f013f680 2024-08-15T17:54:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f014eb90 con 0x7f57f013f680 2024-08-15T17:54:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d40052b0 con 0x7f57f013f680 2024-08-15T17:54:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.847+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f57d80123d0 con 0x7f57f013f680 2024-08-15T17:54:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.851+0000 7f57e6ffd700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f57d0060860 0x7f57d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.851+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57d807cca0 con 0x7f57f013f680 2024-08-15T17:54:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.851+0000 7f57eeffd700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f57d0060860 0x7f57d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.851+0000 7f57eeffd700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f57d0060860 0x7f57d0062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009880 tx=0x7f57e8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:20.855+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f57d804d050 con 0x7f57f013f680 2024-08-15T17:54:21.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.019+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57d4005ae0 con 0x7f57f013f680 2024-08-15T17:54:21.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.019+0000 7f57e6ffd700 1 -- 172.21.15.33:0/3785891840 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57d8050670 con 0x7f57f013f680 2024-08-15T17:54:21.021 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f57d0060860 msgr2=0x7f57d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f57d0060860 0x7f57d0062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009880 tx=0x7f57e8018000 comp rx=0 tx=0).stop 2024-08-15T17:54:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 msgr2=0x7f57f00ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 0x7f57f00ab810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e900 tx=0x7f57d80091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 shutdown_connections 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f57d0060860 0x7f57d0062d10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57f013fa50 0x7f57f00a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f013f680 0x7f57f00ab810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 --2- 172.21.15.33:0/3785891840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57f00b0100 0x7f57f0150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 >> 172.21.15.33:0/3785891840 conn(0x7f57f00678a0 msgr2=0x7f57f012f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 shutdown_connections 2024-08-15T17:54:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.023+0000 7f57effff700 1 -- 172.21.15.33:0/3785891840 wait complete. 2024-08-15T17:54:21.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:21.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 Processor -- start 2024-08-15T17:54:21.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 -- start start 2024-08-15T17:54:21.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0048140a30 0x7f00480c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0048140e00 0x7f00480cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00480c3b90 con 0x7f00480b0e30 2024-08-15T17:54:21.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480ca510 con 0x7f0048140a30 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ec7f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480ca7f0 con 0x7f0048140e00 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004d21c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f00480b0e30 0x7f00480cc180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42440/0 (socket says 172.21.15.33:42440) 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004d21c700 1 -- 172.21.15.33:0/2472320741 learned_addr learned my addr 172.21.15.33:0/2472320741 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.151+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2472320741 >> v2:172.21.15.33:3300/0 conn(0x7f0048140a30 0x7f00480c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003ffff700 1 --2- 172.21.15.33:0/2472320741 >> v2:172.21.15.105:3300/0 conn(0x7f0048140e00 0x7f00480cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003f7fe700 1 -- 172.21.15.33:0/2472320741 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028909993 0 0) 0x7f00480c3b90 con 0x7f00480b0e30 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003f7fe700 1 -- 172.21.15.33:0/2472320741 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0030003570 con 0x7f00480b0e30 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003f7fe700 1 -- 172.21.15.33:0/2472320741 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823936203 0 0) 0x7f0030003570 con 0x7f00480b0e30 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ca1b700 1 -- 172.21.15.33:0/2472320741 >> v2:172.21.15.105:3300/0 conn(0x7f0048140e00 msgr2=0x7f00480cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2472320741 >> v2:172.21.15.105:3300/0 conn(0x7f0048140e00 0x7f00480cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ca1b700 1 -- 172.21.15.33:0/2472320741 >> v1:172.21.15.33:6789/0 conn(0x7f00480b0e30 legacy=0x7f00480cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ca1b700 1 -- 172.21.15.33:0/2472320741 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480c37d0 con 0x7f0048140a30 2024-08-15T17:54:21.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2472320741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140a30 0x7f00480c86b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0048067fd0 tx=0x7f00440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2496971d22dc2e36 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003f7fe700 1 -- 172.21.15.33:0/2472320741 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400017f0 con 0x7f0048140a30 2024-08-15T17:54:21.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003f7fe700 1 -- 172.21.15.33:0/2472320741 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044011420 con 0x7f0048140a30 2024-08-15T17:54:21.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f003f7fe700 1 -- 172.21.15.33:0/2472320741 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440117c0 con 0x7f0048140a30 2024-08-15T17:54:21.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 -- 172.21.15.33:0/2472320741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140a30 msgr2=0x7f00480c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2472320741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140a30 0x7f00480c86b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0048067fd0 tx=0x7f00440091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 -- 172.21.15.33:0/2472320741 shutdown_connections 2024-08-15T17:54:21.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2472320741 >> v2:172.21.15.105:3300/0 conn(0x7f0048140e00 0x7f00480cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2472320741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140a30 0x7f00480c86b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 -- 172.21.15.33:0/2472320741 >> 172.21.15.33:0/2472320741 conn(0x7f00480caae0 msgr2=0x7f00480caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 -- 172.21.15.33:0/2472320741 shutdown_connections 2024-08-15T17:54:21.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.155+0000 7f004ec7f700 1 -- 172.21.15.33:0/2472320741 wait complete. 2024-08-15T17:54:21.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 Processor -- start 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 -- start start 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00480b0e30 0x7f00480c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0048140a30 0x7f0048137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 0x7f00480c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480c6780 con 0x7f0048140e00 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480c5b70 con 0x7f0048140a30 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ec7f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480c5e50 con 0x7f00480b0e30 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 0x7f00480c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 0x7f00480c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46542/0 (socket says 172.21.15.33:46542) 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 -- 172.21.15.33:0/2391958897 learned_addr learned my addr 172.21.15.33:0/2391958897 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00480b0e30 0x7f00480c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f003ffff700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0048140a30 0x7f0048137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 -- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00480b0e30 msgr2=0x7f00480c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00480b0e30 0x7f00480c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 -- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0048140a30 msgr2=0x7f0048137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0048140a30 0x7f0048137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 -- 172.21.15.33:0/2391958897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044009420 con 0x7f0048140e00 2024-08-15T17:54:21.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f003ffff700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0048140a30 0x7f0048137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00480b0e30 0x7f00480c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f004d21c700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 0x7f00480c5120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0040001560 tx=0x7f0040001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040004dc0 con 0x7f0048140e00 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.159+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000a6a0 con 0x7f0048140e00 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000aa60 con 0x7f0048140e00 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00480c6130 con 0x7f0048140e00 2024-08-15T17:54:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004813a540 con 0x7f0048140e00 2024-08-15T17:54:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00481574c0 con 0x7f0048140e00 2024-08-15T17:54:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0040007150 con 0x7f0048140e00 2024-08-15T17:54:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f003cff9700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0034060860 0x7f0034062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f004007c230 con 0x7f0048140e00 2024-08-15T17:54:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.163+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0034060860 0x7f0034062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.167+0000 7f004ca1b700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0034060860 0x7f0034062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0048067fd0 tx=0x7f0044016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.171+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f00481574c0 con 0x7f0048140e00 2024-08-15T17:54:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.339+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00481574c0 con 0x7f0048140e00 2024-08-15T17:54:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.339+0000 7f003cff9700 1 -- 172.21.15.33:0/2391958897 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0040018020 con 0x7f0048140e00 2024-08-15T17:54:21.341 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0034060860 msgr2=0x7f0034062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0034060860 0x7f0034062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0048067fd0 tx=0x7f0044016000 comp rx=0 tx=0).stop 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 msgr2=0x7f00480c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 0x7f00480c5120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0040001560 tx=0x7f0040001640 comp rx=0 tx=0).stop 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 shutdown_connections 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0034060860 0x7f0034062d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0048140a30 0x7f0048137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0048140e00 0x7f00480c5120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 --2- 172.21.15.33:0/2391958897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00480b0e30 0x7f00480c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 >> 172.21.15.33:0/2391958897 conn(0x7f00480caae0 msgr2=0x7f00480b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 shutdown_connections 2024-08-15T17:54:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.343+0000 7f004ec7f700 1 -- 172.21.15.33:0/2391958897 wait complete. 2024-08-15T17:54:21.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:21.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 Processor -- start 2024-08-15T17:54:21.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 -- start start 2024-08-15T17:54:21.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3580af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa3580a9430 0x7fa3580b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580b0270 con 0x7fa35806e830 2024-08-15T17:54:21.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3580af660 con 0x7fa3580a9430 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa360380700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580af940 con 0x7fa35815d540 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d91b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa35806e830 0x7fa3580a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42456/0 (socket says 172.21.15.33:42456) 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d91b700 1 -- 172.21.15.33:0/3017285098 learned_addr learned my addr 172.21.15.33:0/3017285098 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e91d700 1 --2- 172.21.15.33:0/3017285098 >> v2:172.21.15.105:3300/0 conn(0x7fa3580a9430 0x7fa3580b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e11c700 1 --2- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3580af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d11a700 1 -- 172.21.15.33:0/3017285098 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862819000 0 0) 0x7fa3580b0270 con 0x7fa35806e830 2024-08-15T17:54:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d11a700 1 -- 172.21.15.33:0/3017285098 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa340003570 con 0x7fa35806e830 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e91d700 1 -- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 msgr2=0x7fa3580af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e91d700 1 --2- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3580af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e91d700 1 -- 172.21.15.33:0/3017285098 >> v1:172.21.15.33:6789/0 conn(0x7fa35806e830 legacy=0x7fa3580a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e91d700 1 -- 172.21.15.33:0/3017285098 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580afc20 con 0x7fa3580a9430 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35e91d700 1 --2- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3580a9430 0x7fa3580b0700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa3480098e0 tx=0x7fa3480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c86074eb49d2eb server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d11a700 1 -- 172.21.15.33:0/3017285098 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011630 con 0x7fa3580a9430 2024-08-15T17:54:21.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d11a700 1 -- 172.21.15.33:0/3017285098 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348011790 con 0x7fa3580a9430 2024-08-15T17:54:21.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.459+0000 7fa35d11a700 1 -- 172.21.15.33:0/3017285098 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011b10 con 0x7fa3580a9430 2024-08-15T17:54:21.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 -- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3580a9430 msgr2=0x7fa3580b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 --2- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3580a9430 0x7fa3580b0700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa3480098e0 tx=0x7fa3480091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 -- 172.21.15.33:0/3017285098 shutdown_connections 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 --2- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3580a9430 0x7fa3580b0700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 --2- 172.21.15.33:0/3017285098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3580af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 -- 172.21.15.33:0/3017285098 >> 172.21.15.33:0/3017285098 conn(0x7fa358066e00 msgr2=0x7fa358067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 -- 172.21.15.33:0/3017285098 shutdown_connections 2024-08-15T17:54:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 -- 172.21.15.33:0/3017285098 wait complete. 2024-08-15T17:54:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 Processor -- start 2024-08-15T17:54:21.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.463+0000 7fa360380700 1 -- start start 2024-08-15T17:54:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35806e830 0x7fa3580cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 0x7fa35816d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3581583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35816e8c0 con 0x7fa3580a9430 2024-08-15T17:54:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35816da00 con 0x7fa35806e830 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35816dcd0 con 0x7fa35815d540 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 0x7fa35816d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 0x7fa35816d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46548/0 (socket says 172.21.15.33:46548) 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 -- 172.21.15.33:0/632396511 learned_addr learned my addr 172.21.15.33:0/632396511 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35e11c700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35806e830 0x7fa3580cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35e91d700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3581583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 -- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 msgr2=0x7fa3581583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3581583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 -- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35806e830 msgr2=0x7fa3580cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35806e830 0x7fa3580cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 -- 172.21.15.33:0/632396511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348009420 con 0x7fa3580a9430 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35e91d700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3581583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa35d91b700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 0x7fa35816d4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa35000cd00 tx=0x7fa350001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000ce60 con 0x7fa3580a9430 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35000ab10 con 0x7fa3580a9430 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35816dfb0 con 0x7fa3580a9430 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500070f0 con 0x7fa3580a9430 2024-08-15T17:54:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.467+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa358158920 con 0x7fa3580a9430 2024-08-15T17:54:21.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.471+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35816e4b0 con 0x7fa3580a9430 2024-08-15T17:54:21.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.471+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa350007460 con 0x7fa3580a9430 2024-08-15T17:54:21.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.471+0000 7fa3567fc700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa344060860 0x7fa344062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.471+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa35007d0d0 con 0x7fa3580a9430 2024-08-15T17:54:21.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.471+0000 7fa35e11c700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa344060860 0x7fa344062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.471+0000 7fa35e11c700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa344060860 0x7fa344062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009d10 tx=0x7fa34c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.479+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa35004d500 con 0x7fa3580a9430 2024-08-15T17:54:21.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.647+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3580645c0 con 0x7fa3580a9430 2024-08-15T17:54:21.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.647+0000 7fa3567fc700 1 -- 172.21.15.33:0/632396511 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa350050b20 con 0x7fa3580a9430 2024-08-15T17:54:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:21.650 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:21.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa344060860 msgr2=0x7fa344062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa344060860 0x7fa344062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009d10 tx=0x7fa34c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 msgr2=0x7fa35816d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 0x7fa35816d4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa35000cd00 tx=0x7fa350001b00 comp rx=0 tx=0).stop 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 shutdown_connections 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa344060860 0x7fa344062d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa35815d540 0x7fa3581583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3580a9430 0x7fa35816d4c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 --2- 172.21.15.33:0/632396511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35806e830 0x7fa3580cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 >> 172.21.15.33:0/632396511 conn(0x7fa358066e00 msgr2=0x7fa358067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 shutdown_connections 2024-08-15T17:54:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.651+0000 7fa360380700 1 -- 172.21.15.33:0/632396511 wait complete. 2024-08-15T17:54:21.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:21.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:21.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.775+0000 7fd0557b8700 1 Processor -- start 2024-08-15T17:54:21.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.775+0000 7fd0557b8700 1 -- start start 2024-08-15T17:54:21.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd0501590b0 0x7fd050066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0500ce210 con 0x7fd0500cd2b0 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05015dc20 con 0x7fd050159480 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0500cba00 con 0x7fd0501590b0 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd054fb7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd0500cd2b0 0x7fd05015d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42462/0 (socket says 172.21.15.33:42462) 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd054fb7700 1 -- 172.21.15.33:0/3585212392 learned_addr learned my addr 172.21.15.33:0/3585212392 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 --2- 172.21.15.33:0/3585212392 >> v2:172.21.15.105:3300/0 conn(0x7fd0501590b0 0x7fd050066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332205538 0 0) 0x7fd0500ce210 con 0x7fd0500cd2b0 2024-08-15T17:54:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd03c003570 con 0x7fd0500cd2b0 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152290519 0 0) 0x7fd05015dc20 con 0x7fd050159480 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0500ce210 con 0x7fd050159480 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582247263 0 0) 0x7fd03c003570 con 0x7fd0500cd2b0 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 >> v2:172.21.15.105:3300/0 conn(0x7fd0501590b0 msgr2=0x7fd050066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 --2- 172.21.15.33:0/3585212392 >> v2:172.21.15.105:3300/0 conn(0x7fd0501590b0 0x7fd050066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 >> v1:172.21.15.105:6789/0 conn(0x7fd050159480 legacy=0x7fd05015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500cb440 con 0x7fd0500cd2b0 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fd0480017f0 con 0x7fd0500cd2b0 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 >> v1:172.21.15.33:6789/0 conn(0x7fd0500cd2b0 legacy=0x7fd05015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd03c003bf0 0x7fd03c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c004810 0x7fd03c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd03c0051c0 0x7fd03c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c00c080 con 0x7fd03c003bf0 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c00c1f0 con 0x7fd03c004810 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c00c3b0 con 0x7fd03c0051c0 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd03c003bf0 0x7fd03c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04f7fe700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c004810 0x7fd03c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd054fb7700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd03c0051c0 0x7fd03c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 -- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd03c0051c0 msgr2=0x7fd03c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd03c0051c0 0x7fd03c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 -- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c004810 msgr2=0x7fd03c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c004810 0x7fd03c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 -- 172.21.15.33:0/3585212392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c003570 con 0x7fd03c003bf0 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd054fb7700 1 -- 172.21.15.33:0/3585212392 reap_dead start 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04ffff700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd03c003bf0 0x7fd03c003fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd038009c00 tx=0x7fd0380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8ab386eff657ed server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800e710 con 0x7fd03c003bf0 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800e870 con 0x7fd03c003bf0 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd04effd700 1 -- 172.21.15.33:0/3585212392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800ec30 con 0x7fd03c003bf0 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- 172.21.15.33:0/3585212392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd03c003bf0 msgr2=0x7fd03c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd03c003bf0 0x7fd03c003fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd038009c00 tx=0x7fd0380091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- 172.21.15.33:0/3585212392 shutdown_connections 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 --2- 172.21.15.33:0/3585212392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd03c003bf0 0x7fd03c003fe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- 172.21.15.33:0/3585212392 >> 172.21.15.33:0/3585212392 conn(0x7fd0500d0b90 msgr2=0x7fd0500ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- 172.21.15.33:0/3585212392 shutdown_connections 2024-08-15T17:54:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.779+0000 7fd0557b8700 1 -- 172.21.15.33:0/3585212392 wait complete. 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 Processor -- start 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 -- start start 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c003bf0 0x7fd050141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 0x7fd0500cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05014f9a0 0x7fd05014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0501506d0 con 0x7fd0500ce880 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500cf230 con 0x7fd03c003bf0 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd0557b8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05013f6d0 con 0x7fd05014f9a0 2024-08-15T17:54:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 0x7fd0500cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 0x7fd0500cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46556/0 (socket says 172.21.15.33:46556) 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd04ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c003bf0 0x7fd050141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd04f7fe700 1 -- 172.21.15.33:0/2182511805 learned_addr learned my addr 172.21.15.33:0/2182511805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.783+0000 7fd054fb7700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05014f9a0 0x7fd05014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04ffff700 1 -- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05014f9a0 msgr2=0x7fd05014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04ffff700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05014f9a0 0x7fd05014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04ffff700 1 -- 172.21.15.33:0/2182511805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 msgr2=0x7fd0500cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04ffff700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 0x7fd0500cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04ffff700 1 -- 172.21.15.33:0/2182511805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05013f9b0 con 0x7fd03c003bf0 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04f7fe700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 0x7fd0500cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd04ffff700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c003bf0 0x7fd050141db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd038006f00 tx=0x7fd03801a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038022070 con 0x7fd03c003bf0 2024-08-15T17:54:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05013fc90 con 0x7fd03c003bf0 2024-08-15T17:54:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd050150350 con 0x7fd03c003bf0 2024-08-15T17:54:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800e9e0 con 0x7fd03c003bf0 2024-08-15T17:54:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800e710 con 0x7fd03c003bf0 2024-08-15T17:54:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0340052b0 con 0x7fd03c003bf0 2024-08-15T17:54:21.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd03801c660 con 0x7fd03c003bf0 2024-08-15T17:54:21.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.787+0000 7fd047fff700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd030060890 0x7fd030062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:21.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.791+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd03807e7f0 con 0x7fd03c003bf0 2024-08-15T17:54:21.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.791+0000 7fd04f7fe700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd030060890 0x7fd030062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:21.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.791+0000 7fd04f7fe700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd030060890 0x7fd030062d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd0500b53d0 tx=0x7fd040007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:21.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.799+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd03804f250 con 0x7fd03c003bf0 2024-08-15T17:54:21.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.967+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd034005ae0 con 0x7fd03c003bf0 2024-08-15T17:54:21.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.967+0000 7fd047fff700 1 -- 172.21.15.33:0/2182511805 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd03802b0a0 con 0x7fd03c003bf0 2024-08-15T17:54:21.968 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:21.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd030060890 msgr2=0x7fd030062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd030060890 0x7fd030062d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd0500b53d0 tx=0x7fd040007d30 comp rx=0 tx=0).stop 2024-08-15T17:54:21.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c003bf0 msgr2=0x7fd050141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:21.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c003bf0 0x7fd050141db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd038006f00 tx=0x7fd03801a000 comp rx=0 tx=0).stop 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 shutdown_connections 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd030060890 0x7fd030062d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05014f9a0 0x7fd05014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0500ce880 0x7fd0500cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 --2- 172.21.15.33:0/2182511805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03c003bf0 0x7fd050141db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 >> 172.21.15.33:0/2182511805 conn(0x7fd0500d0b90 msgr2=0x7fd0501576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 shutdown_connections 2024-08-15T17:54:21.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:21.971+0000 7fd0557b8700 1 -- 172.21.15.33:0/2182511805 wait complete. 2024-08-15T17:54:21.989 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:22.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.103+0000 7f4591691700 1 Processor -- start 2024-08-15T17:54:22.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.103+0000 7f4591691700 1 -- start start 2024-08-15T17:54:22.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4591691700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0cbab0 0x7f458c0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4591691700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f458c0ad6e0 0x7f458c0adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4591691700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c0c8c30 con 0x7f458c140910 2024-08-15T17:54:22.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4591691700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c0cc470 con 0x7f458c0ad6e0 2024-08-15T17:54:22.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4591691700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0c3e30 con 0x7f458c0cbab0 2024-08-15T17:54:22.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f458c0ad6e0 0x7f458c0adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f458c0ad6e0 0x7f458c0adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46572/0 (socket says 172.21.15.33:46572) 2024-08-15T17:54:22.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 -- 172.21.15.33:0/2763138553 learned_addr learned my addr 172.21.15.33:0/2763138553 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:22.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f458b7fe700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0cbab0 0x7f458c0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 -- 172.21.15.33:0/2763138553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0cbab0 msgr2=0x7f458c0cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0cbab0 0x7f458c0cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 -- 172.21.15.33:0/2763138553 >> v1:172.21.15.105:6789/0 conn(0x7f458c140910 legacy=0x7f458c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f458affd700 1 -- 172.21.15.33:0/2763138553 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032555804 0 0) 0x7f458c0c8c30 con 0x7f458c140910 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 -- 172.21.15.33:0/2763138553 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c0c4110 con 0x7f458c0ad6e0 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f458b7fe700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0cbab0 0x7f458c0cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f4590e90700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0ad6e0 0x7f458c0adae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4584009f20 tx=0x7f4584009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c18b913a5dbceca server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f458affd700 1 -- 172.21.15.33:0/2763138553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400e070 con 0x7f458c0ad6e0 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f458affd700 1 -- 172.21.15.33:0/2763138553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458400b9d0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.107+0000 7f458affd700 1 -- 172.21.15.33:0/2763138553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840092e0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 -- 172.21.15.33:0/2763138553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0ad6e0 msgr2=0x7f458c0adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0ad6e0 0x7f458c0adae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4584009f20 tx=0x7f4584009840 comp rx=0 tx=0).stop 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 -- 172.21.15.33:0/2763138553 shutdown_connections 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0ad6e0 0x7f458c0adae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 --2- 172.21.15.33:0/2763138553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0cbab0 0x7f458c0cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 -- 172.21.15.33:0/2763138553 >> 172.21.15.33:0/2763138553 conn(0x7f458c0cdee0 msgr2=0x7f458c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 -- 172.21.15.33:0/2763138553 shutdown_connections 2024-08-15T17:54:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 -- 172.21.15.33:0/2763138553 wait complete. 2024-08-15T17:54:22.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 Processor -- start 2024-08-15T17:54:22.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.111+0000 7f4591691700 1 -- start start 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0ad6e0 0x7f458c160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 0x7f458c06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c140910 0x7f458c06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c167f50 con 0x7f458c0cbab0 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c1684a0 con 0x7f458c140910 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0a5e90 con 0x7f458c0ad6e0 2024-08-15T17:54:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 0x7f458c06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 0x7f458c06b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46586/0 (socket says 172.21.15.33:46586) 2024-08-15T17:54:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458b7fe700 1 -- 172.21.15.33:0/2786197579 learned_addr learned my addr 172.21.15.33:0/2786197579 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0ad6e0 0x7f458c160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4590e90700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c140910 0x7f458c06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 -- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c140910 msgr2=0x7f458c06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c140910 0x7f458c06bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 -- 172.21.15.33:0/2786197579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 msgr2=0x7f458c06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 0x7f458c06b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 -- 172.21.15.33:0/2786197579 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574009420 con 0x7f458c0ad6e0 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458b7fe700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 0x7f458c06b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f458bfff700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0ad6e0 0x7f458c160e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c5b0 tx=0x7f457c007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011590 con 0x7f458c0ad6e0 2024-08-15T17:54:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c011710 con 0x7f458c0ad6e0 2024-08-15T17:54:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4584009ae0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011ad0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.115+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c06c430 con 0x7f458c0ad6e0 2024-08-15T17:54:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.119+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f457c01b3b0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.119+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c0638f0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.119+0000 7f4583fff700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f456c060860 0x7f456c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.119+0000 7f458b7fe700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f456c060860 0x7f456c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.119+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f457c07bfe0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.119+0000 7f458b7fe700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f456c060860 0x7f456c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f458c0c5a00 tx=0x7f45740091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.127+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f457c04c430 con 0x7f458c0ad6e0 2024-08-15T17:54:22.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.295+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f458c1400f0 con 0x7f458c0ad6e0 2024-08-15T17:54:22.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.295+0000 7f4583fff700 1 -- 172.21.15.33:0/2786197579 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f457c017020 con 0x7f458c0ad6e0 2024-08-15T17:54:22.297 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f456c060860 msgr2=0x7f456c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f456c060860 0x7f456c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f458c0c5a00 tx=0x7f45740091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0ad6e0 msgr2=0x7f458c160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0ad6e0 0x7f458c160e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c5b0 tx=0x7f457c007d30 comp rx=0 tx=0).stop 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 shutdown_connections 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f456c060860 0x7f456c062d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c140910 0x7f458c06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f458c0cbab0 0x7f458c06b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 --2- 172.21.15.33:0/2786197579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c0ad6e0 0x7f458c160e50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 >> 172.21.15.33:0/2786197579 conn(0x7f458c0cdee0 msgr2=0x7f458c0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:22.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 shutdown_connections 2024-08-15T17:54:22.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.299+0000 7f4591691700 1 -- 172.21.15.33:0/2786197579 wait complete. 2024-08-15T17:54:22.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:22.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.419+0000 7f669359e700 1 Processor -- start 2024-08-15T17:54:22.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.419+0000 7f669359e700 1 -- start start 2024-08-15T17:54:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f669413f680 0x7f66940aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f669413fa50 0x7f66940ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66940b0100 0x7f669406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940afc70 con 0x7f669413fa50 2024-08-15T17:54:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940adc00 con 0x7f669413f680 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66940af060 con 0x7f66940b0100 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f669413fa50 0x7f66940ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f669413fa50 0x7f66940ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46600/0 (socket says 172.21.15.33:46600) 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 -- 172.21.15.33:0/3017507294 learned_addr learned my addr 172.21.15.33:0/3017507294 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6692d9d700 1 --2- 172.21.15.33:0/3017507294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66940b0100 0x7f669406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669259c700 1 --2- 172.21.15.33:0/3017507294 >> v2:172.21.15.105:3300/0 conn(0x7f669413f680 0x7f66940aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 -- 172.21.15.33:0/3017507294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66940b0100 msgr2=0x7f669406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 --2- 172.21.15.33:0/3017507294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66940b0100 0x7f669406e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 -- 172.21.15.33:0/3017507294 >> v2:172.21.15.105:3300/0 conn(0x7f669413f680 msgr2=0x7f66940aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 --2- 172.21.15.33:0/3017507294 >> v2:172.21.15.105:3300/0 conn(0x7f669413f680 0x7f66940aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 -- 172.21.15.33:0/3017507294 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940af340 con 0x7f669413fa50 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6689d9b700 1 --2- 172.21.15.33:0/3017507294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413fa50 0x7f66940ad6c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f669406ca10 tx=0x7f667c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb79dd0a8d591207 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6691d9b700 1 -- 172.21.15.33:0/3017507294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00b860 con 0x7f669413fa50 2024-08-15T17:54:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6691d9b700 1 -- 172.21.15.33:0/3017507294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00b9c0 con 0x7f669413fa50 2024-08-15T17:54:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f6691d9b700 1 -- 172.21.15.33:0/3017507294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00bd60 con 0x7f669413fa50 2024-08-15T17:54:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- 172.21.15.33:0/3017507294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413fa50 msgr2=0x7f66940ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- 172.21.15.33:0/3017507294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413fa50 0x7f66940ad6c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f669406ca10 tx=0x7f667c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- 172.21.15.33:0/3017507294 shutdown_connections 2024-08-15T17:54:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- 172.21.15.33:0/3017507294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66940b0100 0x7f669406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- 172.21.15.33:0/3017507294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413fa50 0x7f66940ad6c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 --2- 172.21.15.33:0/3017507294 >> v2:172.21.15.105:3300/0 conn(0x7f669413f680 0x7f66940aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- 172.21.15.33:0/3017507294 >> 172.21.15.33:0/3017507294 conn(0x7f66940678a0 msgr2=0x7f6694067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- 172.21.15.33:0/3017507294 shutdown_connections 2024-08-15T17:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.423+0000 7f669359e700 1 -- 172.21.15.33:0/3017507294 wait complete. 2024-08-15T17:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 Processor -- start 2024-08-15T17:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 -- start start 2024-08-15T17:54:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66940b0100 0x7f6694068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 0x7f66940aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f669413fa50 0x7f669406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694069460 con 0x7f669413f680 2024-08-15T17:54:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694069740 con 0x7f66940b0100 2024-08-15T17:54:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6694069a20 con 0x7f669413fa50 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 0x7f66940aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 0x7f66940aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46602/0 (socket says 172.21.15.33:46602) 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 -- 172.21.15.33:0/3811038352 learned_addr learned my addr 172.21.15.33:0/3811038352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669259c700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66940b0100 0x7f6694068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6692d9d700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f669413fa50 0x7f669406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 -- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f669413fa50 msgr2=0x7f669406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f669413fa50 0x7f669406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 -- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66940b0100 msgr2=0x7f6694068e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66940b0100 0x7f6694068e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 -- 172.21.15.33:0/3811038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0094f0 con 0x7f669413f680 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f6689d9b700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 0x7f66940aadf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f669406fbb0 tx=0x7f667c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c011dc0 con 0x7f669413f680 2024-08-15T17:54:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c024440 con 0x7f669413f680 2024-08-15T17:54:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694069d00 con 0x7f669413f680 2024-08-15T17:54:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c024800 con 0x7f669413f680 2024-08-15T17:54:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.427+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66940ab330 con 0x7f669413f680 2024-08-15T17:54:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.431+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669406a1e0 con 0x7f669413f680 2024-08-15T17:54:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.431+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f667c01a420 con 0x7f669413f680 2024-08-15T17:54:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.431+0000 7f668affd700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6674060860 0x7f6674062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.431+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f667c07eab0 con 0x7f669413f680 2024-08-15T17:54:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.431+0000 7f669259c700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6674060860 0x7f6674062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.435+0000 7f669259c700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6674060860 0x7f6674062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6684006fd0 tx=0x7f6684008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.439+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f667c04ee60 con 0x7f669413f680 2024-08-15T17:54:22.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.603+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6694064330 con 0x7f669413f680 2024-08-15T17:54:22.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.603+0000 7f668affd700 1 -- 172.21.15.33:0/3811038352 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f667c052480 con 0x7f669413f680 2024-08-15T17:54:22.605 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6674060860 msgr2=0x7f6674062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6674060860 0x7f6674062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6684006fd0 tx=0x7f6684008040 comp rx=0 tx=0).stop 2024-08-15T17:54:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 msgr2=0x7f66940aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 0x7f66940aadf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f669406fbb0 tx=0x7f667c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 shutdown_connections 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6674060860 0x7f6674062d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f669413fa50 0x7f669406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669413f680 0x7f66940aadf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 --2- 172.21.15.33:0/3811038352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66940b0100 0x7f6694068e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 >> 172.21.15.33:0/3811038352 conn(0x7f66940678a0 msgr2=0x7f669413d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 shutdown_connections 2024-08-15T17:54:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.607+0000 7f669359e700 1 -- 172.21.15.33:0/3811038352 wait complete. 2024-08-15T17:54:22.687 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-15T17:54:22.687 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-15T17:54:22.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:22.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.795+0000 7fe87acda700 1 Processor -- start 2024-08-15T17:54:22.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.795+0000 7fe87acda700 1 -- start start 2024-08-15T17:54:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8740b0d20 0x7fe87406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe874141a00 con 0x7fe8740b1630 2024-08-15T17:54:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87406e8a0 con 0x7fe8740b0d20 2024-08-15T17:54:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874140b10 con 0x7fe87406e450 2024-08-15T17:54:22.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe879cd8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8740b0d20 0x7fe87406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:52658/0 (socket says 172.21.15.33:52658) 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 -- 172.21.15.33:0/2439557435 learned_addr learned my addr 172.21.15.33:0/2439557435 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 -- 172.21.15.33:0/2439557435 >> v2:172.21.15.105:3300/0 conn(0x7fe8740b0d20 msgr2=0x7fe87406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 --2- 172.21.15.33:0/2439557435 >> v2:172.21.15.105:3300/0 conn(0x7fe8740b0d20 0x7fe87406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 -- 172.21.15.33:0/2439557435 >> v1:172.21.15.105:6789/0 conn(0x7fe8740b1630 legacy=0x7fe8741610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 -- 172.21.15.33:0/2439557435 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874140df0 con 0x7fe87406e450 2024-08-15T17:54:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe878cd6700 1 -- 172.21.15.33:0/2439557435 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306229650 0 0) 0x7fe874141a00 con 0x7fe8740b1630 2024-08-15T17:54:22.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe8794d7700 1 --2- 172.21.15.33:0/2439557435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740b10f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe868009f20 tx=0x7fe868009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85858770ecea4e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe878cd6700 1 -- 172.21.15.33:0/2439557435 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800e070 con 0x7fe87406e450 2024-08-15T17:54:22.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe878cd6700 1 -- 172.21.15.33:0/2439557435 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800b9d0 con 0x7fe87406e450 2024-08-15T17:54:22.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe878cd6700 1 -- 172.21.15.33:0/2439557435 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680092e0 con 0x7fe87406e450 2024-08-15T17:54:22.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- 172.21.15.33:0/2439557435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 msgr2=0x7fe8740b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 --2- 172.21.15.33:0/2439557435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740b10f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe868009f20 tx=0x7fe868009840 comp rx=0 tx=0).stop 2024-08-15T17:54:22.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- 172.21.15.33:0/2439557435 shutdown_connections 2024-08-15T17:54:22.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 --2- 172.21.15.33:0/2439557435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740b10f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 --2- 172.21.15.33:0/2439557435 >> v2:172.21.15.105:3300/0 conn(0x7fe8740b0d20 0x7fe87406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- 172.21.15.33:0/2439557435 >> 172.21.15.33:0/2439557435 conn(0x7fe8740678d0 msgr2=0x7fe874067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- 172.21.15.33:0/2439557435 shutdown_connections 2024-08-15T17:54:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.799+0000 7fe87acda700 1 -- 172.21.15.33:0/2439557435 wait complete. 2024-08-15T17:54:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 Processor -- start 2024-08-15T17:54:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 -- start start 2024-08-15T17:54:22.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8740b0d20 0x7fe8740a8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8740b1630 0x7fe87416e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874146690 con 0x7fe8740b1630 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874145a80 con 0x7fe8740b0d20 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874145d60 con 0x7fe87406e450 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87a4d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8740b1630 0x7fe87416e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8740b0d20 0x7fe8740a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87a4d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8740b1630 0x7fe87416e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46618/0 (socket says 172.21.15.33:46618) 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87a4d9700 1 -- 172.21.15.33:0/756738884 learned_addr learned my addr 172.21.15.33:0/756738884 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe879cd8700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 -- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 msgr2=0x7fe8740a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 -- 172.21.15.33:0/756738884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8740b1630 msgr2=0x7fe87416e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8740b1630 0x7fe87416e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 -- 172.21.15.33:0/756738884 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009ae0 con 0x7fe8740b0d20 2024-08-15T17:54:22.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe8794d7700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8740b0d20 0x7fe8740a8250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe868015000 tx=0x7fe868018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868008970 con 0x7fe8740b0d20 2024-08-15T17:54:22.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868008af0 con 0x7fe8740b0d20 2024-08-15T17:54:22.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe874146040 con 0x7fe8740b0d20 2024-08-15T17:54:22.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868026460 con 0x7fe8740b0d20 2024-08-15T17:54:22.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.803+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87416e570 con 0x7fe8740b0d20 2024-08-15T17:54:22.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.807+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87416ecc0 con 0x7fe8740b0d20 2024-08-15T17:54:22.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.807+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe868003040 con 0x7fe8740b0d20 2024-08-15T17:54:22.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.807+0000 7fe865ffb700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe858060860 0x7fe858062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:22.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.807+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe86807e9b0 con 0x7fe8740b0d20 2024-08-15T17:54:22.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.807+0000 7fe879cd8700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe858060860 0x7fe858062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:22.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.807+0000 7fe879cd8700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe858060860 0x7fe858062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe8740b13a0 tx=0x7fe8700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.815+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe86804ede0 con 0x7fe8740b0d20 2024-08-15T17:54:22.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.987+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe87416ecc0 con 0x7fe8740b0d20 2024-08-15T17:54:22.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.987+0000 7fe865ffb700 1 -- 172.21.15.33:0/756738884 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe87416ecc0 con 0x7fe8740b0d20 2024-08-15T17:54:22.990 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:22.991 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe858060860 msgr2=0x7fe858062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe858060860 0x7fe858062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe8740b13a0 tx=0x7fe8700091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8740b0d20 msgr2=0x7fe8740a8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8740b0d20 0x7fe8740a8250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe868015000 tx=0x7fe868018000 comp rx=0 tx=0).stop 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 shutdown_connections 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe858060860 0x7fe858062d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8740b0d20 0x7fe8740a8250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8740b1630 0x7fe87416e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 --2- 172.21.15.33:0/756738884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406e450 0x7fe8740a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 >> 172.21.15.33:0/756738884 conn(0x7fe8740678d0 msgr2=0x7fe87415db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 shutdown_connections 2024-08-15T17:54:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:22.991+0000 7fe87acda700 1 -- 172.21.15.33:0/756738884 wait complete. 2024-08-15T17:54:23.011 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:23.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:23.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:54:23.083 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:54:23.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.123+0000 7fbee339f700 1 Processor -- start 2024-08-15T17:54:23.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee339f700 1 -- start start 2024-08-15T17:54:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee339f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 0x7fbedc159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee339f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc06a3b0 con 0x7fbedc0c8b70 2024-08-15T17:54:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee339f700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0a9fe0 con 0x7fbedc158fb0 2024-08-15T17:54:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee339f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0c9010 con 0x7fbedc068db0 2024-08-15T17:54:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee193c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbedc0c8b70 0x7fbedc0aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42466/0 (socket says 172.21.15.33:42466) 2024-08-15T17:54:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee193c700 1 -- 172.21.15.33:0/2647339228 learned_addr learned my addr 172.21.15.33:0/2647339228 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 0x7fbedc159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695777638 0 0) 0x7fbedc06a3b0 con 0x7fbedc0c8b70 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec4003570 con 0x7fbedc0c8b70 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744858209 0 0) 0x7fbec4003570 con 0x7fbedc0c8b70 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 msgr2=0x7fbedc159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 0x7fbedc159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 >> v1:172.21.15.105:6789/0 conn(0x7fbedc158fb0 legacy=0x7fbedc0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc06a0d0 con 0x7fbedc0c8b70 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fbed4001470 con 0x7fbedc0c8b70 2024-08-15T17:54:23.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 >> v1:172.21.15.33:6789/0 conn(0x7fbedc0c8b70 legacy=0x7fbedc0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec4003a90 0x7fbec4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec4004810 0x7fbec4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 0x7fbec40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0c9010 con 0x7fbec4004810 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec400bb60 con 0x7fbec4003a90 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec400bd20 con 0x7fbedc068db0 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec4004810 0x7fbec4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee113b700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec4003a90 0x7fbec4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee193c700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 0x7fbec40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 -- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 msgr2=0x7fbec40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc068db0 0x7fbec40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 -- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec4003a90 msgr2=0x7fbec4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec4003a90 0x7fbec4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 -- 172.21.15.33:0/2647339228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4003570 con 0x7fbec4004810 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee113b700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec4003a90 0x7fbec4003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbee093a700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec4004810 0x7fbec4004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009c00 tx=0x7fbed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325d0ebc2d72b74 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000e710 con 0x7fbec4004810 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed000e870 con 0x7fbec4004810 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.127+0000 7fbedbfff700 1 -- 172.21.15.33:0/2647339228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000ec30 con 0x7fbec4004810 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- 172.21.15.33:0/2647339228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec4004810 msgr2=0x7fbec4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 --2- 172.21.15.33:0/2647339228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec4004810 0x7fbec4004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009c00 tx=0x7fbed00091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 -- 172.21.15.33:0/2647339228 reap_dead start 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- 172.21.15.33:0/2647339228 shutdown_connections 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- 172.21.15.33:0/2647339228 >> 172.21.15.33:0/2647339228 conn(0x7fbedc0c9bf0 msgr2=0x7fbedc06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- 172.21.15.33:0/2647339228 shutdown_connections 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- 172.21.15.33:0/2647339228 wait complete. 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 Processor -- start 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- start start 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc14f460 0x7fbedc14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbedc1502b0 0x7fbedc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 0x7fbedc156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc150700 con 0x7fbedc155440 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ab340 con 0x7fbedc1502b0 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee339f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ab620 con 0x7fbedc14f460 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 0x7fbedc156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee113b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc14f460 0x7fbedc14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 0x7fbedc156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46628/0 (socket says 172.21.15.33:46628) 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 -- 172.21.15.33:0/1715535777 learned_addr learned my addr 172.21.15.33:0/1715535777 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee093a700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbedc1502b0 0x7fbedc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 -- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc14f460 msgr2=0x7fbedc14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc14f460 0x7fbedc14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 -- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbedc1502b0 msgr2=0x7fbedc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbedc1502b0 0x7fbedc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 -- 172.21.15.33:0/1715535777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0ab900 con 0x7fbedc155440 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee093a700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbedc1502b0 0x7fbedc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbee193c700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 0x7fbedc156fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0cc6d0 tx=0x7fbed4000ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.131+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40114f0 con 0x7fbedc155440 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4011670 con 0x7fbedc155440 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0abbe0 con 0x7fbedc155440 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4011a30 con 0x7fbedc155440 2024-08-15T17:54:23.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc1558b0 con 0x7fbedc155440 2024-08-15T17:54:23.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc0645c0 con 0x7fbedc155440 2024-08-15T17:54:23.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbed40133e0 con 0x7fbedc155440 2024-08-15T17:54:23.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbed97fa700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbec8060860 0x7fbec8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbed407c2f0 con 0x7fbedc155440 2024-08-15T17:54:23.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.135+0000 7fbee113b700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbec8060860 0x7fbec8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.139+0000 7fbee113b700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbec8060860 0x7fbec8062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0040c0 tx=0x7fbecc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.143+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbed404c740 con 0x7fbedc155440 2024-08-15T17:54:23.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.311+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbedc0afc30 con 0x7fbedc155440 2024-08-15T17:54:23.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbed97fa700 1 -- 172.21.15.33:0/1715535777 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbed40190a0 con 0x7fbedc155440 2024-08-15T17:54:23.315 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:23.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbec8060860 msgr2=0x7fbec8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbec8060860 0x7fbec8062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0040c0 tx=0x7fbecc009040 comp rx=0 tx=0).stop 2024-08-15T17:54:23.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 msgr2=0x7fbedc156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 0x7fbedc156fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0cc6d0 tx=0x7fbed4000ce0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 shutdown_connections 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbec8060860 0x7fbec8062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbedc1502b0 0x7fbedc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbedc155440 0x7fbedc156fa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 --2- 172.21.15.33:0/1715535777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbedc14f460 0x7fbedc14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 >> 172.21.15.33:0/1715535777 conn(0x7fbedc0c9bf0 msgr2=0x7fbedc153810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 shutdown_connections 2024-08-15T17:54:23.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.315+0000 7fbee339f700 1 -- 172.21.15.33:0/1715535777 wait complete. 2024-08-15T17:54:23.331 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc36d6f6700 1 Processor -- start 2024-08-15T17:54:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc36d6f6700 1 -- start start 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc36d6f6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3681532e0 0x7fc3680b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc36d6f6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680ace30 con 0x7fc36806ead0 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc36d6f6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc368156dd0 con 0x7fc36806eea0 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc36d6f6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc368156450 con 0x7fc3681532e0 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc367fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc36806ead0 0x7fc368155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42468/0 (socket says 172.21.15.33:42468) 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.495+0000 7fc367fff700 1 -- 172.21.15.33:0/2665098349 learned_addr learned my addr 172.21.15.33:0/2665098349 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36cef5700 1 --2- 172.21.15.33:0/2665098349 >> v2:172.21.15.105:3300/0 conn(0x7fc3681532e0 0x7fc3680b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054733464 0 0) 0x7fc3680ace30 con 0x7fc36806ead0 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc348004680 con 0x7fc36806ead0 2024-08-15T17:54:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464919611 0 0) 0x7fc368156dd0 con 0x7fc36806eea0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3680ace30 con 0x7fc36806eea0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1592127324 0 0) 0x7fc348004680 con 0x7fc36806ead0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36cef5700 1 -- 172.21.15.33:0/2665098349 >> v1:172.21.15.105:6789/0 conn(0x7fc36806eea0 legacy=0x7fc368152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36cef5700 1 -- 172.21.15.33:0/2665098349 >> v1:172.21.15.33:6789/0 conn(0x7fc36806ead0 legacy=0x7fc368155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36cef5700 1 -- 172.21.15.33:0/2665098349 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368156730 con 0x7fc3681532e0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36cef5700 1 --2- 172.21.15.33:0/2665098349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc3680b1830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc360009e60 tx=0x7fc360009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283150fcdab4935 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000e070 con 0x7fc3681532e0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000b7a0 con 0x7fc3681532e0 2024-08-15T17:54:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc366ffd700 1 -- 172.21.15.33:0/2665098349 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358001470 con 0x7fc3681532e0 2024-08-15T17:54:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 -- 172.21.15.33:0/2665098349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 msgr2=0x7fc3680b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/2665098349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc3680b1830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc360009e60 tx=0x7fc360009780 comp rx=0 tx=0).stop 2024-08-15T17:54:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 -- 172.21.15.33:0/2665098349 shutdown_connections 2024-08-15T17:54:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/2665098349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc3680b1830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 -- 172.21.15.33:0/2665098349 >> 172.21.15.33:0/2665098349 conn(0x7fc3680678a0 msgr2=0x7fc368067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 -- 172.21.15.33:0/2665098349 shutdown_connections 2024-08-15T17:54:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.499+0000 7fc36d6f6700 1 -- 172.21.15.33:0/2665098349 wait complete. 2024-08-15T17:54:23.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 Processor -- start 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 -- start start 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 0x7fc3680a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc36806eea0 0x7fc3681576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc368157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680a6340 con 0x7fc36806ead0 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680a5eb0 con 0x7fc3681532e0 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681683f0 con 0x7fc36806eea0 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 0x7fc3680a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 0x7fc3680a9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46644/0 (socket says 172.21.15.33:46644) 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 -- 172.21.15.33:0/882143643 learned_addr learned my addr 172.21.15.33:0/882143643 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc3677fe700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc36806eea0 0x7fc3681576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36cef5700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc368157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 -- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc36806eea0 msgr2=0x7fc3681576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc36806eea0 0x7fc3681576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 -- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 msgr2=0x7fc368157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc368157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 -- 172.21.15.33:0/882143643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360009a20 con 0x7fc36806ead0 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc3677fe700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc36806eea0 0x7fc3681576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36cef5700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc368157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc367fff700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 0x7fc3680a9710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc35800cba0 tx=0x7fc358001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358007360 con 0x7fc36806ead0 2024-08-15T17:54:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580074c0 con 0x7fc36806ead0 2024-08-15T17:54:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680a5580 con 0x7fc36806ead0 2024-08-15T17:54:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358004830 con 0x7fc36806ead0 2024-08-15T17:54:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.503+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680a5b40 con 0x7fc36806ead0 2024-08-15T17:54:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.507+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc368064330 con 0x7fc36806ead0 2024-08-15T17:54:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.507+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc358004ba0 con 0x7fc36806ead0 2024-08-15T17:54:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.507+0000 7fc35ffff700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc34c060860 0x7fc34c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.507+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc35807c2e0 con 0x7fc36806ead0 2024-08-15T17:54:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.507+0000 7fc3677fe700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc34c060860 0x7fc34c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.507+0000 7fc3677fe700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc34c060860 0x7fc34c062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3681569e0 tx=0x7fc350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.515+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc35804c7b0 con 0x7fc36806ead0 2024-08-15T17:54:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.679+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3680add40 con 0x7fc36806ead0 2024-08-15T17:54:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.679+0000 7fc35ffff700 1 -- 172.21.15.33:0/882143643 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc35804fdd0 con 0x7fc36806ead0 2024-08-15T17:54:23.680 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:23.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc34c060860 msgr2=0x7fc34c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc34c060860 0x7fc34c062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3681569e0 tx=0x7fc350009040 comp rx=0 tx=0).stop 2024-08-15T17:54:23.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 msgr2=0x7fc3680a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 0x7fc3680a9710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc35800cba0 tx=0x7fc358001ab0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 shutdown_connections 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fc34c060860 0x7fc34c062d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3681532e0 0x7fc368157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc36806eea0 0x7fc3681576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 --2- 172.21.15.33:0/882143643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36806ead0 0x7fc3680a9710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 >> 172.21.15.33:0/882143643 conn(0x7fc3680678a0 msgr2=0x7fc36806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 shutdown_connections 2024-08-15T17:54:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.683+0000 7fc36d6f6700 1 -- 172.21.15.33:0/882143643 wait complete. 2024-08-15T17:54:23.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:23.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.807+0000 7fee7bfff700 1 Processor -- start 2024-08-15T17:54:23.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.807+0000 7fee7bfff700 1 -- start start 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee7c0b0390 0x7fee7c0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fee7c15cda0 0x7fee7c15d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c15d780 0x7fee7c159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0ca760 con 0x7fee7c0b0390 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0cd3f0 con 0x7fee7c15cda0 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0cc350 con 0x7fee7c15d780 2024-08-15T17:54:23.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee7c0b0390 0x7fee7c0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee7c0b0390 0x7fee7c0cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46650/0 (socket says 172.21.15.33:46650) 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 -- 172.21.15.33:0/3661918782 learned_addr learned my addr 172.21.15.33:0/3661918782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7a7fc700 1 --2- 172.21.15.33:0/3661918782 >> v2:172.21.15.105:3300/0 conn(0x7fee7c15cda0 0x7fee7c15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7b7fe700 1 --2- 172.21.15.33:0/3661918782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c15d780 0x7fee7c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 -- 172.21.15.33:0/3661918782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c15d780 msgr2=0x7fee7c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 --2- 172.21.15.33:0/3661918782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c15d780 0x7fee7c159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 -- 172.21.15.33:0/3661918782 >> v2:172.21.15.105:3300/0 conn(0x7fee7c15cda0 msgr2=0x7fee7c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:23.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 --2- 172.21.15.33:0/3661918782 >> v2:172.21.15.105:3300/0 conn(0x7fee7c15cda0 0x7fee7c15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 -- 172.21.15.33:0/3661918782 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0cc630 con 0x7fee7c0b0390 2024-08-15T17:54:23.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7affd700 1 --2- 172.21.15.33:0/3661918782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0b0390 0x7fee7c0cbcc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee7c065680 tx=0x7fee70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be169aa683d3639 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee79ffb700 1 -- 172.21.15.33:0/3661918782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000b640 con 0x7fee7c0b0390 2024-08-15T17:54:23.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee79ffb700 1 -- 172.21.15.33:0/3661918782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000b7a0 con 0x7fee7c0b0390 2024-08-15T17:54:23.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee79ffb700 1 -- 172.21.15.33:0/3661918782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000bb60 con 0x7fee7c0b0390 2024-08-15T17:54:23.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- 172.21.15.33:0/3661918782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0b0390 msgr2=0x7fee7c0cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- 172.21.15.33:0/3661918782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0b0390 0x7fee7c0cbcc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee7c065680 tx=0x7fee70009250 comp rx=0 tx=0).stop 2024-08-15T17:54:23.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- 172.21.15.33:0/3661918782 shutdown_connections 2024-08-15T17:54:23.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- 172.21.15.33:0/3661918782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c15d780 0x7fee7c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- 172.21.15.33:0/3661918782 >> v2:172.21.15.105:3300/0 conn(0x7fee7c15cda0 0x7fee7c15d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 --2- 172.21.15.33:0/3661918782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0b0390 0x7fee7c0cbcc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- 172.21.15.33:0/3661918782 >> 172.21.15.33:0/3661918782 conn(0x7fee7c0cdee0 msgr2=0x7fee7c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:23.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- 172.21.15.33:0/3661918782 shutdown_connections 2024-08-15T17:54:23.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.811+0000 7fee7bfff700 1 -- 172.21.15.33:0/3661918782 wait complete. 2024-08-15T17:54:23.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.815+0000 7fee7bfff700 1 Processor -- start 2024-08-15T17:54:23.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.815+0000 7fee7bfff700 1 -- start start 2024-08-15T17:54:23.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c0b0390 0x7fee7c0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee7c15cda0 0x7fee7c069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 0x7fee7c069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0c7660 con 0x7fee7c15d780 2024-08-15T17:54:23.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c169f50 con 0x7fee7c15cda0 2024-08-15T17:54:23.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b1190 con 0x7fee7c0b0390 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 0x7fee7c069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 0x7fee7c069750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46666/0 (socket says 172.21.15.33:46666) 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 -- 172.21.15.33:0/1843266127 learned_addr learned my addr 172.21.15.33:0/1843266127 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7a7fc700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee7c15cda0 0x7fee7c069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7affd700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c0b0390 0x7fee7c0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 -- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c0b0390 msgr2=0x7fee7c0b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c0b0390 0x7fee7c0b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 -- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee7c15cda0 msgr2=0x7fee7c069210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee7c15cda0 0x7fee7c069210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 -- 172.21.15.33:0/1843266127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700094f0 con 0x7fee7c15d780 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7b7fe700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 0x7fee7c069750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e20 tx=0x7fee7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7400caa0 con 0x7fee7c15d780 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7400f040 con 0x7fee7c15d780 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c169990 con 0x7fee7c15d780 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7400ce70 con 0x7fee7c15d780 2024-08-15T17:54:23.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c0b0e20 con 0x7fee7c15d780 2024-08-15T17:54:23.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.819+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c0638f0 con 0x7fee7c15d780 2024-08-15T17:54:23.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.823+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fee74014690 con 0x7fee7c15d780 2024-08-15T17:54:23.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.823+0000 7fee62ffd700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fee68060860 0x7fee68062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:23.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.823+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee7407d4f0 con 0x7fee7c15d780 2024-08-15T17:54:23.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.823+0000 7fee7affd700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fee68060860 0x7fee68062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:23.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.823+0000 7fee7affd700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fee68060860 0x7fee68062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fee7c065680 tx=0x7fee70017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:23.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.831+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fee740513e0 con 0x7fee7c15d780 2024-08-15T17:54:23.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee7c0b12d0 con 0x7fee7c15d780 2024-08-15T17:54:23.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee62ffd700 1 -- 172.21.15.33:0/1843266127 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee74050f70 con 0x7fee7c15d780 2024-08-15T17:54:23.999 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fee68060860 msgr2=0x7fee68062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fee68060860 0x7fee68062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fee7c065680 tx=0x7fee70017000 comp rx=0 tx=0).stop 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 msgr2=0x7fee7c069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 0x7fee7c069750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e20 tx=0x7fee7400b040 comp rx=0 tx=0).stop 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 shutdown_connections 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fee68060860 0x7fee68062d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee7c15cda0 0x7fee7c069210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c15d780 0x7fee7c069750 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 --2- 172.21.15.33:0/1843266127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee7c0b0390 0x7fee7c0b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 >> 172.21.15.33:0/1843266127 conn(0x7fee7c0cdee0 msgr2=0x7fee7c156710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:24.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 shutdown_connections 2024-08-15T17:54:24.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:23.999+0000 7fee7bfff700 1 -- 172.21.15.33:0/1843266127 wait complete. 2024-08-15T17:54:24.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-15T17:54:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.119+0000 7f409f967700 1 Processor -- start 2024-08-15T17:54:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.119+0000 7f409f967700 1 -- start start 2024-08-15T17:54:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4098159810 0x7f40980b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40980cf150 0x7f40980c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980ce120 con 0x7f40980d0dd0 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980c5c60 con 0x7f40980cf150 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980ce390 con 0x7f4098159810 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40980cf150 0x7f40980c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40980cf150 0x7f40980c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46668/0 (socket says 172.21.15.33:46668) 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 -- 172.21.15.33:0/238958703 learned_addr learned my addr 172.21.15.33:0/238958703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409d703700 1 --2- 172.21.15.33:0/238958703 >> v2:172.21.15.105:3300/0 conn(0x7f4098159810 0x7f40980b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 -- 172.21.15.33:0/238958703 >> v2:172.21.15.105:3300/0 conn(0x7f4098159810 msgr2=0x7f40980b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 --2- 172.21.15.33:0/238958703 >> v2:172.21.15.105:3300/0 conn(0x7f4098159810 0x7f40980b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 -- 172.21.15.33:0/238958703 >> v1:172.21.15.105:6789/0 conn(0x7f40980d0dd0 legacy=0x7f40980cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 -- 172.21.15.33:0/238958703 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980ce670 con 0x7f40980cf150 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409df04700 1 --2- 172.21.15.33:0/238958703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40980cf150 0x7f40980c6390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4098089580 tx=0x7f4090009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d5a323f0405d94 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f408ffff700 1 -- 172.21.15.33:0/238958703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000e070 con 0x7f40980cf150 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f408ffff700 1 -- 172.21.15.33:0/238958703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000ba20 con 0x7f40980cf150 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f408ffff700 1 -- 172.21.15.33:0/238958703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900092e0 con 0x7f40980cf150 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- 172.21.15.33:0/238958703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40980cf150 msgr2=0x7f40980c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 --2- 172.21.15.33:0/238958703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40980cf150 0x7f40980c6390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4098089580 tx=0x7f4090009840 comp rx=0 tx=0).stop 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- 172.21.15.33:0/238958703 shutdown_connections 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 --2- 172.21.15.33:0/238958703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40980cf150 0x7f40980c6390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 --2- 172.21.15.33:0/238958703 >> v2:172.21.15.105:3300/0 conn(0x7f4098159810 0x7f40980b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- 172.21.15.33:0/238958703 >> 172.21.15.33:0/238958703 conn(0x7f4098067590 msgr2=0x7f40980d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- 172.21.15.33:0/238958703 shutdown_connections 2024-08-15T17:54:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.123+0000 7f409f967700 1 -- 172.21.15.33:0/238958703 wait complete. 2024-08-15T17:54:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 Processor -- start 2024-08-15T17:54:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 -- start start 2024-08-15T17:54:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40980cf150 0x7f4098154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40980d0dd0 0x7f409809b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 0x7f4098068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981554d0 con 0x7f4098159810 2024-08-15T17:54:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409809a500 con 0x7f40980d0dd0 2024-08-15T17:54:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409809a7e0 con 0x7f40980cf150 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 0x7f4098068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 0x7f4098068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46670/0 (socket says 172.21.15.33:46670) 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 -- 172.21.15.33:0/2181879754 learned_addr learned my addr 172.21.15.33:0/2181879754 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409cf02700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40980d0dd0 0x7f409809b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409d703700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40980cf150 0x7f4098154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 -- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40980cf150 msgr2=0x7f4098154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40980cf150 0x7f4098154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 -- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40980d0dd0 msgr2=0x7f409809b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40980d0dd0 0x7f409809b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 -- 172.21.15.33:0/2181879754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090009ae0 con 0x7f4098159810 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409d703700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40980cf150 0x7f4098154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409df04700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 0x7f4098068820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4090009880 tx=0x7f4090018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090008b30 con 0x7f4098159810 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090008c90 con 0x7f4098159810 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409809aac0 con 0x7f4098159810 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900266b0 con 0x7f4098159810 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.127+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409809b080 con 0x7f4098159810 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.131+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409809b2a0 con 0x7f4098159810 2024-08-15T17:54:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.131+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4090003040 con 0x7f4098159810 2024-08-15T17:54:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.131+0000 7f408d7fa700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f407c060860 0x7f407c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.131+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f409007ea70 con 0x7f4098159810 2024-08-15T17:54:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.131+0000 7f409d703700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f407c060860 0x7f407c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.131+0000 7f409d703700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f407c060860 0x7f407c062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4088009ce0 tx=0x7f4088008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.135+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f409004eec0 con 0x7f4098159810 2024-08-15T17:54:24.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:24.363+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f40980645c0 con 0x7f4098159810 2024-08-15T17:54:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.355+0000 7f408d7fa700 1 -- 172.21.15.33:0/2181879754 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f40900524e0 con 0x7f4098159810 2024-08-15T17:54:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f407c060860 msgr2=0x7f407c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f407c060860 0x7f407c062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4088009ce0 tx=0x7f4088008040 comp rx=0 tx=0).stop 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 msgr2=0x7f4098068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 0x7f4098068820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4090009880 tx=0x7f4090018000 comp rx=0 tx=0).stop 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 shutdown_connections 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f407c060860 0x7f407c062d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40980d0dd0 0x7f409809b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4098159810 0x7f4098068820 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 --2- 172.21.15.33:0/2181879754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40980cf150 0x7f4098154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 >> 172.21.15.33:0/2181879754 conn(0x7f4098067590 msgr2=0x7f40980d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 shutdown_connections 2024-08-15T17:54:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.359+0000 7f409f967700 1 -- 172.21.15.33:0/2181879754 wait complete. 2024-08-15T17:54:25.379 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-15T17:54:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.495+0000 7f0d17fff700 1 Processor -- start 2024-08-15T17:54:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.495+0000 7f0d17fff700 1 -- start start 2024-08-15T17:54:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d17fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 0x7f0d1815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d17fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d1815d9f0 0x7f0d180c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d17fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d180cc350 con 0x7f0d180b0390 2024-08-15T17:54:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d17fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d180ca760 con 0x7f0d1815d9f0 2024-08-15T17:54:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d17fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180cd3f0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d1815d9f0 0x7f0d180c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d167fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 0x7f0d1815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d16ffd700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0d180b0390 0x7f0d1815cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:41112/0 (socket says 172.21.15.33:41112) 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d1815d9f0 0x7f0d180c2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55488/0 (socket says 172.21.15.33:55488) 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d167fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 0x7f0d1815d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:52726/0 (socket says 172.21.15.33:52726) 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d16ffd700 1 -- 172.21.15.33:0/3288972237 learned_addr learned my addr 172.21.15.33:0/3288972237 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 -- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 msgr2=0x7f0d1815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 --2- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 0x7f0d1815d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 -- 172.21.15.33:0/3288972237 >> v1:172.21.15.105:6789/0 conn(0x7f0d180b0390 legacy=0x7f0d1815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 -- 172.21.15.33:0/3288972237 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180cc630 con 0x7f0d1815d9f0 2024-08-15T17:54:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d167fc700 1 --2- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 0x7f0d1815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d177fe700 1 --2- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d1815d9f0 0x7f0d180c2c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009e60 tx=0x7f0d10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44accd65c70f9ce1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d15ffb700 1 -- 172.21.15.33:0/3288972237 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000e070 con 0x7f0d1815d9f0 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d15ffb700 1 -- 172.21.15.33:0/3288972237 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1000bb60 con 0x7f0d1815d9f0 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.499+0000 7f0d15ffb700 1 -- 172.21.15.33:0/3288972237 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10012430 con 0x7f0d1815d9f0 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d1815d9f0 msgr2=0x7f0d180c2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 --2- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d1815d9f0 0x7f0d180c2c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009e60 tx=0x7f0d10009780 comp rx=0 tx=0).stop 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- 172.21.15.33:0/3288972237 shutdown_connections 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 --2- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d1815d9f0 0x7f0d180c2c80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 --2- 172.21.15.33:0/3288972237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d180cbcc0 0x7f0d1815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- 172.21.15.33:0/3288972237 >> 172.21.15.33:0/3288972237 conn(0x7f0d180cdee0 msgr2=0x7f0d180ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- 172.21.15.33:0/3288972237 shutdown_connections 2024-08-15T17:54:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- 172.21.15.33:0/3288972237 wait complete. 2024-08-15T17:54:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 Processor -- start 2024-08-15T17:54:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- start start 2024-08-15T17:54:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d180b0390 0x7f0d181444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 0x7f0d180c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d1815d9f0 0x7f0d18143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c54d0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c6100 con 0x7f0d180b0390 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.503+0000 7f0d17fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c63a0 con 0x7f0d1815d9f0 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 0x7f0d180c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 0x7f0d180c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46682/0 (socket says 172.21.15.33:46682) 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 -- 172.21.15.33:0/2685277285 learned_addr learned my addr 172.21.15.33:0/2685277285 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d177fe700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d1815d9f0 0x7f0d18143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d16ffd700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d180b0390 0x7f0d181444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 -- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d1815d9f0 msgr2=0x7f0d18143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d1815d9f0 0x7f0d18143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 -- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d180b0390 msgr2=0x7f0d181444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d180b0390 0x7f0d181444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 -- 172.21.15.33:0/2685277285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009420 con 0x7f0d180cbcc0 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d177fe700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d1815d9f0 0x7f0d18143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d167fc700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 0x7f0d180c4f90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800ec80 tx=0x7f0d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800c9d0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800cb30 con 0x7f0d180cbcc0 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800ced0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d10009a20 con 0x7f0d180cbcc0 2024-08-15T17:54:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d180b39f0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.507+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d180b3c10 con 0x7f0d180cbcc0 2024-08-15T17:54:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.511+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d08013680 con 0x7f0d180cbcc0 2024-08-15T17:54:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.511+0000 7f0d0effd700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0cf8060860 0x7f0cf8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.511+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d0807cfe0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.511+0000 7f0d16ffd700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0cf8060860 0x7f0cf8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.511+0000 7f0d16ffd700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0cf8060860 0x7f0cf8062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d00001820 tx=0x7f0d00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:25.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.519+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d0804d3b0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.691+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d180638f0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d0effd700 1 -- 172.21.15.33:0/2685277285 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d080509d0 con 0x7f0d180cbcc0 2024-08-15T17:54:25.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0cf8060860 msgr2=0x7f0cf8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0cf8060860 0x7f0cf8062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d00001820 tx=0x7f0d00009040 comp rx=0 tx=0).stop 2024-08-15T17:54:25.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 msgr2=0x7f0d180c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:25.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 0x7f0d180c4f90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800ec80 tx=0x7f0d080091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 shutdown_connections 2024-08-15T17:54:25.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0cf8060860 0x7f0cf8062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d1815d9f0 0x7f0d18143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cbcc0 0x7f0d180c4f90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2685277285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d180b0390 0x7f0d181444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:25.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 >> 172.21.15.33:0/2685277285 conn(0x7f0d180cdee0 msgr2=0x7f0d1806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 shutdown_connections 2024-08-15T17:54:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:25.699+0000 7f0d17fff700 1 -- 172.21.15.33:0/2685277285 wait complete. 2024-08-15T17:54:25.715 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-15T17:54:25.715 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-15T17:54:25.730 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-15T17:54:25.750 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-15T17:54:25.750 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-08-15T17:54:25.750 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-15T17:54:25.750 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:25.795 INFO:teuthology.orchestra.run:waiting for 900 2024-08-15T17:54:25.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:54:25.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:25.795 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-15T17:54:25.829 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi105.front.sepia.ceph.com... 2024-08-15T17:54:25.829 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-15T17:54:25.830 DEBUG:teuthology.orchestra.run.smithi105:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:25.855 INFO:teuthology.orchestra.run:waiting for 900 2024-08-15T17:54:25.855 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:54:25.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:25.855 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-15T17:54:25.918 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-08-15T17:54:25.918 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-15T17:54:25.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-15T17:54:25.935 INFO:teuthology.orchestra.run:waiting for 900 2024-08-15T17:54:25.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:54:25.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:25.936 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-15T17:54:25.985 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi105.front.sepia.ceph.com... 2024-08-15T17:54:25.985 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-15T17:54:25.986 DEBUG:teuthology.orchestra.run.smithi105:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-15T17:54:26.004 INFO:teuthology.orchestra.run:waiting for 900 2024-08-15T17:54:26.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:54:26.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:26.005 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-15T17:54:26.013 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-15T17:54:26.013 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:26.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 Processor -- start 2024-08-15T17:54:26.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 -- start start 2024-08-15T17:54:26.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f567c06e9d0 0x7f567c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f567c0ab540 0x7f567c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c0aba70 con 0x7f567c155010 2024-08-15T17:54:26.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0abd50 con 0x7f567c06e9d0 2024-08-15T17:54:26.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5682e92700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0ac030 con 0x7f567c0ab540 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5681e90700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f567c06e9d0 0x7f567c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5681e90700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f567c06e9d0 0x7f567c06eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46698/0 (socket says 172.21.15.33:46698) 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f5681e90700 1 -- 172.21.15.33:0/3534249466 learned_addr learned my addr 172.21.15.33:0/3534249466 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.131+0000 7f568168f700 1 --2- 172.21.15.33:0/3534249466 >> v2:172.21.15.105:3300/0 conn(0x7f567c0ab540 0x7f567c0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5680e8e700 1 -- 172.21.15.33:0/3534249466 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068688154 0 0) 0x7f567c0aba70 con 0x7f567c155010 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5680e8e700 1 -- 172.21.15.33:0/3534249466 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5664004680 con 0x7f567c155010 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5681e90700 1 -- 172.21.15.33:0/3534249466 >> v2:172.21.15.105:3300/0 conn(0x7f567c0ab540 msgr2=0x7f567c0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5681e90700 1 --2- 172.21.15.33:0/3534249466 >> v2:172.21.15.105:3300/0 conn(0x7f567c0ab540 0x7f567c0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5681e90700 1 -- 172.21.15.33:0/3534249466 >> v1:172.21.15.105:6789/0 conn(0x7f567c155010 legacy=0x7f567c155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5681e90700 1 -- 172.21.15.33:0/3534249466 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0ac310 con 0x7f567c06e9d0 2024-08-15T17:54:26.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5681e90700 1 --2- 172.21.15.33:0/3534249466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c06e9d0 0x7f567c06eda0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ae820 tx=0x7f5678009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40f188705ed9608 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5680e8e700 1 -- 172.21.15.33:0/3534249466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567800e070 con 0x7f567c06e9d0 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5680e8e700 1 -- 172.21.15.33:0/3534249466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567800b970 con 0x7f567c06e9d0 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5680e8e700 1 -- 172.21.15.33:0/3534249466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56780092e0 con 0x7f567c06e9d0 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 -- 172.21.15.33:0/3534249466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c06e9d0 msgr2=0x7f567c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 --2- 172.21.15.33:0/3534249466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c06e9d0 0x7f567c06eda0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ae820 tx=0x7f5678009840 comp rx=0 tx=0).stop 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 -- 172.21.15.33:0/3534249466 shutdown_connections 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 --2- 172.21.15.33:0/3534249466 >> v2:172.21.15.105:3300/0 conn(0x7f567c0ab540 0x7f567c0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 --2- 172.21.15.33:0/3534249466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c06e9d0 0x7f567c06eda0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 -- 172.21.15.33:0/3534249466 >> 172.21.15.33:0/3534249466 conn(0x7f567c0678d0 msgr2=0x7f567c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:26.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 -- 172.21.15.33:0/3534249466 shutdown_connections 2024-08-15T17:54:26.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.135+0000 7f5682e92700 1 -- 172.21.15.33:0/3534249466 wait complete. 2024-08-15T17:54:26.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.139+0000 7f5682e92700 1 Processor -- start 2024-08-15T17:54:26.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.139+0000 7f5682e92700 1 -- start start 2024-08-15T17:54:26.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.139+0000 7f5682e92700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f567c06e9d0 0x7f567c1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.139+0000 7f5682e92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 0x7f567c1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682e92700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f567c155010 0x7f567c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682e92700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1650e0 con 0x7f567c0ab540 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682e92700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1653c0 con 0x7f567c06e9d0 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682e92700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1529a0 con 0x7f567c155010 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 0x7f567c1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5681e90700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f567c06e9d0 0x7f567c1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 0x7f567c1520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46700/0 (socket says 172.21.15.33:46700) 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 -- 172.21.15.33:0/3118431546 learned_addr learned my addr 172.21.15.33:0/3118431546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682691700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f567c155010 0x7f567c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 -- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f567c155010 msgr2=0x7f567c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f567c155010 0x7f567c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 -- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f567c06e9d0 msgr2=0x7f567c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f567c06e9d0 0x7f567c1408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 -- 172.21.15.33:0/3118431546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5678009ae0 con 0x7f567c0ab540 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f568168f700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 0x7f567c1520a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f566c00ec50 tx=0x7f566c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c009690 con 0x7f567c0ab540 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c00c850 con 0x7f567c0ab540 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c152c80 con 0x7f567c0ab540 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c00cbf0 con 0x7f567c0ab540 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c1525e0 con 0x7f567c0ab540 2024-08-15T17:54:26.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.143+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f566c013470 con 0x7f567c0ab540 2024-08-15T17:54:26.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.147+0000 7f5671ffb700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5668060860 0x7f5668062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.147+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c165530 con 0x7f567c0ab540 2024-08-15T17:54:26.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.147+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f566c07cd10 con 0x7f567c0ab540 2024-08-15T17:54:26.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.147+0000 7f5681e90700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5668060860 0x7f5668062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.147+0000 7f5681e90700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5668060860 0x7f5668062d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5678009880 tx=0x7f5678018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.151+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f566c04d160 con 0x7f567c0ab540 2024-08-15T17:54:26.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.355+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f567c0643a0 con 0x7f567c0ab540 2024-08-15T17:54:26.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.359+0000 7f5671ffb700 1 -- 172.21.15.33:0/3118431546 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f566c021090 con 0x7f567c0ab540 2024-08-15T17:54:26.360 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:26.360 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:26.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5668060860 msgr2=0x7f5668062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5668060860 0x7f5668062d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5678009880 tx=0x7f5678018000 comp rx=0 tx=0).stop 2024-08-15T17:54:26.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 msgr2=0x7f567c1520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 0x7f567c1520a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f566c00ec50 tx=0x7f566c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 shutdown_connections 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5668060860 0x7f5668062d10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f567c155010 0x7f567c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f567c0ab540 0x7f567c1520a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 --2- 172.21.15.33:0/3118431546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f567c06e9d0 0x7f567c1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 >> 172.21.15.33:0/3118431546 conn(0x7f567c0678d0 msgr2=0x7f567c151600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 shutdown_connections 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.363+0000 7f5682e92700 1 -- 172.21.15.33:0/3118431546 wait complete. 2024-08-15T17:54:26.364 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:26.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:26.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 Processor -- start 2024-08-15T17:54:26.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 -- start start 2024-08-15T17:54:26.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa16c155d80 0x7fa16c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa16c0af420 0x7fa16c0acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c0af880 con 0x7fa16c0ad090 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0ad8a0 con 0x7fa16c155d80 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16bfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0adb80 con 0x7fa16c0af420 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa16c155d80 0x7fa16c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa16c155d80 0x7fa16c0aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46716/0 (socket says 172.21.15.33:46716) 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16affd700 1 -- 172.21.15.33:0/1392334324 learned_addr learned my addr 172.21.15.33:0/1392334324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.483+0000 7fa16a7fc700 1 --2- 172.21.15.33:0/1392334324 >> v2:172.21.15.105:3300/0 conn(0x7fa16c0af420 0x7fa16c0acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16affd700 1 -- 172.21.15.33:0/1392334324 >> v2:172.21.15.105:3300/0 conn(0x7fa16c0af420 msgr2=0x7fa16c0acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:26.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16affd700 1 --2- 172.21.15.33:0/1392334324 >> v2:172.21.15.105:3300/0 conn(0x7fa16c0af420 0x7fa16c0acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16affd700 1 -- 172.21.15.33:0/1392334324 >> v1:172.21.15.105:6789/0 conn(0x7fa16c0ad090 legacy=0x7fa16c1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16affd700 1 -- 172.21.15.33:0/1392334324 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0ade60 con 0x7fa16c155d80 2024-08-15T17:54:26.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16affd700 1 --2- 172.21.15.33:0/1392334324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c0aeee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa16c06d4c0 tx=0x7fa15c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e473c7354884d40 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa169ffb700 1 -- 172.21.15.33:0/1392334324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c009e70 con 0x7fa16c155d80 2024-08-15T17:54:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa169ffb700 1 -- 172.21.15.33:0/1392334324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00b860 con 0x7fa16c155d80 2024-08-15T17:54:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa169ffb700 1 -- 172.21.15.33:0/1392334324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00bc00 con 0x7fa16c155d80 2024-08-15T17:54:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 -- 172.21.15.33:0/1392334324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 msgr2=0x7fa16c0aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 --2- 172.21.15.33:0/1392334324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c0aeee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa16c06d4c0 tx=0x7fa15c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 -- 172.21.15.33:0/1392334324 shutdown_connections 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 --2- 172.21.15.33:0/1392334324 >> v2:172.21.15.105:3300/0 conn(0x7fa16c0af420 0x7fa16c0acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 --2- 172.21.15.33:0/1392334324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c0aeee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 -- 172.21.15.33:0/1392334324 >> 172.21.15.33:0/1392334324 conn(0x7fa16c06e070 msgr2=0x7fa16c0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 -- 172.21.15.33:0/1392334324 shutdown_connections 2024-08-15T17:54:26.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.487+0000 7fa16bfff700 1 -- 172.21.15.33:0/1392334324 wait complete. 2024-08-15T17:54:26.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 Processor -- start 2024-08-15T17:54:26.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 -- start start 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa16c0ad090 0x7fa16c0a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa16c0af420 0x7fa16c165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c167210 con 0x7fa16c155d80 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c166030 con 0x7fa16c0ad090 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c14aee0 con 0x7fa16c0af420 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c14a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46724/0 (socket says 172.21.15.33:46724) 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16b7fe700 1 -- 172.21.15.33:0/2003968525 learned_addr learned my addr 172.21.15.33:0/2003968525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16affd700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa16c0ad090 0x7fa16c0a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.491+0000 7fa16a7fc700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa16c0af420 0x7fa16c165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16b7fe700 1 -- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa16c0af420 msgr2=0x7fa16c165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16b7fe700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa16c0af420 0x7fa16c165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16b7fe700 1 -- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa16c0ad090 msgr2=0x7fa16c0a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16b7fe700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa16c0ad090 0x7fa16c0a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16b7fe700 1 -- 172.21.15.33:0/2003968525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0094f0 con 0x7fa16c155d80 2024-08-15T17:54:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16affd700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa16c0ad090 0x7fa16c0a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16b7fe700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c14a9a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c8e0 tx=0x7fa164001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164012630 con 0x7fa16c155d80 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164012790 con 0x7fa16c155d80 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c166600 con 0x7fa16c155d80 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164012b50 con 0x7fa16c155d80 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c166bc0 con 0x7fa16c155d80 2024-08-15T17:54:26.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.495+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c0638f0 con 0x7fa16c155d80 2024-08-15T17:54:26.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.499+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa16401a3a0 con 0x7fa16c155d80 2024-08-15T17:54:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.499+0000 7fa152ffd700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa158060860 0x7fa158062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.499+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa16407cbb0 con 0x7fa16c155d80 2024-08-15T17:54:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.499+0000 7fa16affd700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa158060860 0x7fa158062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.499+0000 7fa16affd700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa158060860 0x7fa158062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa16c06d4c0 tx=0x7fa15c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.507+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa164050a90 con 0x7fa16c155d80 2024-08-15T17:54:26.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.675+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa16c0af880 con 0x7fa16c155d80 2024-08-15T17:54:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.675+0000 7fa152ffd700 1 -- 172.21.15.33:0/2003968525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa16c0af880 con 0x7fa16c155d80 2024-08-15T17:54:26.677 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:26.678 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa158060860 msgr2=0x7fa158062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa158060860 0x7fa158062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa16c06d4c0 tx=0x7fa15c019000 comp rx=0 tx=0).stop 2024-08-15T17:54:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 msgr2=0x7fa16c14a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c14a9a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c8e0 tx=0x7fa164001710 comp rx=0 tx=0).stop 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 shutdown_connections 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa158060860 0x7fa158062d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa16c155d80 0x7fa16c14a9a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa16c0af420 0x7fa16c165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 --2- 172.21.15.33:0/2003968525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa16c0ad090 0x7fa16c0a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 >> 172.21.15.33:0/2003968525 conn(0x7fa16c06e070 msgr2=0x7fa16c14b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 shutdown_connections 2024-08-15T17:54:26.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.679+0000 7fa16bfff700 1 -- 172.21.15.33:0/2003968525 wait complete. 2024-08-15T17:54:26.695 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:53:48.060013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:53:49.231300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-15T17:54:26.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:26.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f514a9f4700 1 Processor -- start 2024-08-15T17:54:26.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f514a9f4700 1 -- start start 2024-08-15T17:54:26.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f514a9f4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144159300 0x7f51440b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f514a9f4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440cba90 con 0x7f51441596d0 2024-08-15T17:54:26.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f514a9f4700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440cb160 con 0x7f5144067510 2024-08-15T17:54:26.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f514a9f4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440b2b60 con 0x7f5144159300 2024-08-15T17:54:26.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f51437fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f51441596d0 0x7f5144066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42484/0 (socket says 172.21.15.33:42484) 2024-08-15T17:54:26.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.807+0000 7f51437fe700 1 -- 172.21.15.33:0/1565291962 learned_addr learned my addr 172.21.15.33:0/1565291962 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:26.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5143fff700 1 --2- 172.21.15.33:0/1565291962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144159300 0x7f51440b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172923184 0 0) 0x7f51440cba90 con 0x7f51441596d0 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f512c003570 con 0x7f51441596d0 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170360423 0 0) 0x7f51440cb160 con 0x7f5144067510 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51440cba90 con 0x7f5144067510 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5143fff700 1 -- 172.21.15.33:0/1565291962 >> v1:172.21.15.105:6789/0 conn(0x7f5144067510 legacy=0x7f51440cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5143fff700 1 -- 172.21.15.33:0/1565291962 >> v1:172.21.15.33:6789/0 conn(0x7f51441596d0 legacy=0x7f5144066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2710067089 0 0) 0x7f512c003570 con 0x7f51441596d0 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5143fff700 1 -- 172.21.15.33:0/1565291962 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440cb440 con 0x7f5144159300 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5143fff700 1 --2- 172.21.15.33:0/1565291962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144159300 0x7f51440b2230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5138009910 tx=0x7f51380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76d8df49552f61c server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011630 con 0x7f5144159300 2024-08-15T17:54:26.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138011790 con 0x7f5144159300 2024-08-15T17:54:26.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f5142ffd700 1 -- 172.21.15.33:0/1565291962 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011b10 con 0x7f5144159300 2024-08-15T17:54:26.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 -- 172.21.15.33:0/1565291962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144159300 msgr2=0x7f51440b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1565291962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144159300 0x7f51440b2230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5138009910 tx=0x7f51380091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 -- 172.21.15.33:0/1565291962 shutdown_connections 2024-08-15T17:54:26.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1565291962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144159300 0x7f51440b2230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 -- 172.21.15.33:0/1565291962 >> 172.21.15.33:0/1565291962 conn(0x7f51440682c0 msgr2=0x7f51440686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:26.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 -- 172.21.15.33:0/1565291962 shutdown_connections 2024-08-15T17:54:26.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.811+0000 7f514a9f4700 1 -- 172.21.15.33:0/1565291962 wait complete. 2024-08-15T17:54:26.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 Processor -- start 2024-08-15T17:54:26.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 -- start start 2024-08-15T17:54:26.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144067510 0x7f51440c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 0x7f51440b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51441596d0 0x7f51441494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c7260 con 0x7f5144159300 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c74b0 con 0x7f51441596d0 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f514a9f4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c7790 con 0x7f5144067510 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 0x7f51440b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 0x7f51440b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46736/0 (socket says 172.21.15.33:46736) 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 -- 172.21.15.33:0/1888653543 learned_addr learned my addr 172.21.15.33:0/1888653543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f5143fff700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144067510 0x7f51440c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f5148f91700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51441596d0 0x7f51441494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 -- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144067510 msgr2=0x7f51440c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144067510 0x7f51440c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 -- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51441596d0 msgr2=0x7f51441494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51441596d0 0x7f51441494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 -- 172.21.15.33:0/1888653543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5138009420 con 0x7f5144159300 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f51437fe700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 0x7f51440b4320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f513400c5e0 tx=0x7f5134007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134007360 con 0x7f5144159300 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340074e0 con 0x7f5144159300 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.815+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134004a80 con 0x7f5144159300 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51440c7a70 con 0x7f5144159300 2024-08-15T17:54:26.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51440b4860 con 0x7f5144159300 2024-08-15T17:54:26.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51440645c0 con 0x7f5144159300 2024-08-15T17:54:26.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5134014420 con 0x7f5144159300 2024-08-15T17:54:26.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f512bfff700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5130060860 0x7f5130062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:26.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f513407c830 con 0x7f5144159300 2024-08-15T17:54:26.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.819+0000 7f5143fff700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5130060860 0x7f5130062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:26.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.823+0000 7f5143fff700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5130060860 0x7f5130062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5138009860 tx=0x7f5138017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:26.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.831+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f513404cdb0 con 0x7f5144159300 2024-08-15T17:54:26.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.991+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51440caac0 con 0x7f5144159300 2024-08-15T17:54:26.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.991+0000 7f512bfff700 1 -- 172.21.15.33:0/1888653543 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f513407c070 con 0x7f5144159300 2024-08-15T17:54:26.993 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5130060860 msgr2=0x7f5130062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5130060860 0x7f5130062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5138009860 tx=0x7f5138017000 comp rx=0 tx=0).stop 2024-08-15T17:54:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 msgr2=0x7f51440b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 0x7f51440b4320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f513400c5e0 tx=0x7f5134007b30 comp rx=0 tx=0).stop 2024-08-15T17:54:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 shutdown_connections 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5130060860 0x7f5130062d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51441596d0 0x7f51441494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5144159300 0x7f51440b4320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 --2- 172.21.15.33:0/1888653543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5144067510 0x7f51440c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 >> 172.21.15.33:0/1888653543 conn(0x7f51440682c0 msgr2=0x7f514415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 shutdown_connections 2024-08-15T17:54:26.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:26.995+0000 7f514a9f4700 1 -- 172.21.15.33:0/1888653543 wait complete. 2024-08-15T17:54:27.012 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:54:27.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 Processor -- start 2024-08-15T17:54:27.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 -- start start 2024-08-15T17:54:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f589813f680 0x7f58980aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f589806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980b0810 con 0x7f589813fa50 2024-08-15T17:54:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980afc70 con 0x7f589813f680 2024-08-15T17:54:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.127+0000 7f5897fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980af060 con 0x7f58980ad6c0 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f589813f680 0x7f58980aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f58977fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f589806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f589813f680 0x7f58980aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:55570/0 (socket says 172.21.15.33:55570) 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 -- 172.21.15.33:0/2369415906 learned_addr learned my addr 172.21.15.33:0/2369415906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f588e7fc700 1 --1- 172.21.15.33:0/2369415906 >> v1:172.21.15.105:6789/0 conn(0x7f589813fa50 0x7f58980b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:41140/0 (socket says 172.21.15.33:41140) 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 -- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 msgr2=0x7f589806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 --2- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f589806e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 -- 172.21.15.33:0/2369415906 >> v1:172.21.15.105:6789/0 conn(0x7f589813fa50 legacy=0x7f58980b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 -- 172.21.15.33:0/2369415906 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980af340 con 0x7f589813f680 2024-08-15T17:54:27.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5896ffd700 1 --2- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f58980aea80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58880099b0 tx=0x7f5888009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d80413fa891a7e server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f58967fc700 1 -- 172.21.15.33:0/2369415906 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888009ea0 con 0x7f589813f680 2024-08-15T17:54:27.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f58967fc700 1 -- 172.21.15.33:0/2369415906 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588800b760 con 0x7f589813f680 2024-08-15T17:54:27.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f58967fc700 1 -- 172.21.15.33:0/2369415906 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800bb00 con 0x7f589813f680 2024-08-15T17:54:27.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 -- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 msgr2=0x7f58980aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 --2- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f58980aea80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58880099b0 tx=0x7f5888009250 comp rx=0 tx=0).stop 2024-08-15T17:54:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 -- 172.21.15.33:0/2369415906 shutdown_connections 2024-08-15T17:54:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 --2- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f589806e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 --2- 172.21.15.33:0/2369415906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f58980aea80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 -- 172.21.15.33:0/2369415906 >> 172.21.15.33:0/2369415906 conn(0x7f58980678a0 msgr2=0x7f5898067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 -- 172.21.15.33:0/2369415906 shutdown_connections 2024-08-15T17:54:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.131+0000 7f5897fff700 1 -- 172.21.15.33:0/2369415906 wait complete. 2024-08-15T17:54:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 Processor -- start 2024-08-15T17:54:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 -- start start 2024-08-15T17:54:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f58981651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f5898158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 0x7f5898158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980aabb0 con 0x7f589813fa50 2024-08-15T17:54:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898169700 con 0x7f589813f680 2024-08-15T17:54:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5897fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898168af0 con 0x7f58980ad6c0 2024-08-15T17:54:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 0x7f5898158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 0x7f5898158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46740/0 (socket says 172.21.15.33:46740) 2024-08-15T17:54:27.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 -- 172.21.15.33:0/1670590472 learned_addr learned my addr 172.21.15.33:0/1670590472 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:27.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f588e7fc700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f5898158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f5896ffd700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f58981651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 -- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 msgr2=0x7f58981651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f58981651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 -- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 msgr2=0x7f5898158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f5898158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f58977fe700 1 -- 172.21.15.33:0/1670590472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880094f0 con 0x7f589813fa50 2024-08-15T17:54:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.135+0000 7f588e7fc700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f5898158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f58977fe700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 0x7f5898158970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5890009e90 tx=0x7f589000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000cb70 con 0x7f589813fa50 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000f040 con 0x7f589813fa50 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898168dd0 con 0x7f589813fa50 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890014480 con 0x7f589813fa50 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898169390 con 0x7f589813fa50 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f58900147f0 con 0x7f589813fa50 2024-08-15T17:54:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5898064330 con 0x7f589813fa50 2024-08-15T17:54:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.139+0000 7f588f7fe700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5878060890 0x7f5878062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.143+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f589007d540 con 0x7f589813fa50 2024-08-15T17:54:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.143+0000 7f5896ffd700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5878060890 0x7f5878062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.143+0000 7f5896ffd700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5878060890 0x7f5878062d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f58880099b0 tx=0x7f5888016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.147+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f589004d990 con 0x7f589813fa50 2024-08-15T17:54:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.311+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f589806ed70 con 0x7f589813fa50 2024-08-15T17:54:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f588f7fe700 1 -- 172.21.15.33:0/1670590472 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5890050fb0 con 0x7f589813fa50 2024-08-15T17:54:27.314 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:54:27.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5878060890 msgr2=0x7f5878062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5878060890 0x7f5878062d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f58880099b0 tx=0x7f5888016000 comp rx=0 tx=0).stop 2024-08-15T17:54:27.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 msgr2=0x7f5898158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 0x7f5898158970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5890009e90 tx=0x7f589000b040 comp rx=0 tx=0).stop 2024-08-15T17:54:27.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 shutdown_connections 2024-08-15T17:54:27.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5878060890 0x7f5878062d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f589813f680 0x7f5898158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f589813fa50 0x7f5898158970 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 --2- 172.21.15.33:0/1670590472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58980ad6c0 0x7f58981651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 >> 172.21.15.33:0/1670590472 conn(0x7f58980678a0 msgr2=0x7f58981558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 shutdown_connections 2024-08-15T17:54:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.315+0000 7f5897fff700 1 -- 172.21.15.33:0/1670590472 wait complete. 2024-08-15T17:54:27.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:54:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.443+0000 7ff8b4a57700 1 Processor -- start 2024-08-15T17:54:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.443+0000 7ff8b4a57700 1 -- start start 2024-08-15T17:54:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8b4a57700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff8b00cbf10 0x7ff8b00addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8b4a57700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00c8c30 con 0x7ff8b00cbab0 2024-08-15T17:54:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8b4a57700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00c3e30 con 0x7ff8b0140910 2024-08-15T17:54:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8b4a57700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00c4110 con 0x7ff8b00cbf10 2024-08-15T17:54:27.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8a7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff8b00cbab0 0x7ff8b00ad6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42490/0 (socket says 172.21.15.33:42490) 2024-08-15T17:54:27.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8a7fff700 1 -- 172.21.15.33:0/2838082031 learned_addr learned my addr 172.21.15.33:0/2838082031 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:27.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8af59e700 1 --2- 172.21.15.33:0/2838082031 >> v2:172.21.15.105:3300/0 conn(0x7ff8b00cbf10 0x7ff8b00addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47274677 0 0) 0x7ff8b00c8c30 con 0x7ff8b00cbab0 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff89c003570 con 0x7ff8b00cbab0 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115853643 0 0) 0x7ff8b00c3e30 con 0x7ff8b0140910 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b00c8c30 con 0x7ff8b0140910 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8af59e700 1 -- 172.21.15.33:0/2838082031 >> v1:172.21.15.105:6789/0 conn(0x7ff8b0140910 legacy=0x7ff8b00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8af59e700 1 -- 172.21.15.33:0/2838082031 >> v1:172.21.15.33:6789/0 conn(0x7ff8b00cbab0 legacy=0x7ff8b00ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8af59e700 1 -- 172.21.15.33:0/2838082031 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00c43f0 con 0x7ff8b00cbf10 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8af59e700 1 --2- 172.21.15.33:0/2838082031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbf10 0x7ff8b00addf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009e60 tx=0x7ff8a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27518f481a1186b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800e070 con 0x7ff8b00cbf10 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a800bab0 con 0x7ff8b00cbf10 2024-08-15T17:54:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8ae59c700 1 -- 172.21.15.33:0/2838082031 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800be70 con 0x7ff8b00cbf10 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8b4a57700 1 -- 172.21.15.33:0/2838082031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbf10 msgr2=0x7ff8b00addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.447+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/2838082031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbf10 0x7ff8b00addf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009e60 tx=0x7ff8a8009780 comp rx=0 tx=0).stop 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 -- 172.21.15.33:0/2838082031 shutdown_connections 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/2838082031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbf10 0x7ff8b00addf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 -- 172.21.15.33:0/2838082031 >> 172.21.15.33:0/2838082031 conn(0x7ff8b00cdee0 msgr2=0x7ff8b00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 -- 172.21.15.33:0/2838082031 shutdown_connections 2024-08-15T17:54:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 -- 172.21.15.33:0/2838082031 wait complete. 2024-08-15T17:54:27.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 Processor -- start 2024-08-15T17:54:27.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.451+0000 7ff8b4a57700 1 -- start start 2024-08-15T17:54:27.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbab0 0x7ff8b00a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8b00cbf10 0x7ff8b0167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 0x7ff8b0156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00aa020 con 0x7ff8b0140910 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01693c0 con 0x7ff8b00cbab0 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00a7770 con 0x7ff8b00cbf10 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 0x7ff8b0156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8a7fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8b00cbf10 0x7ff8b0167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 0x7ff8b0156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46746/0 (socket says 172.21.15.33:46746) 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 -- 172.21.15.33:0/392717451 learned_addr learned my addr 172.21.15.33:0/392717451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8aed9d700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbab0 0x7ff8b00a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 -- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8b00cbf10 msgr2=0x7ff8b0167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8b00cbf10 0x7ff8b0167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 -- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbab0 msgr2=0x7ff8b00a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbab0 0x7ff8b00a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 -- 172.21.15.33:0/392717451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009a20 con 0x7ff8b0140910 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8af59e700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 0x7ff8b0156890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8012950 tx=0x7ff8a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8012e10 con 0x7ff8b0140910 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8026480 con 0x7ff8b0140910 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b0168020 con 0x7ff8b0140910 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8026840 con 0x7ff8b0140910 2024-08-15T17:54:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.455+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b0168a90 con 0x7ff8b0140910 2024-08-15T17:54:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.459+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff8a801c400 con 0x7ff8b0140910 2024-08-15T17:54:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.459+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b0169550 con 0x7ff8b0140910 2024-08-15T17:54:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.459+0000 7ff8a6ffd700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff890060860 0x7ff890062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.459+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8a807eb10 con 0x7ff8b0140910 2024-08-15T17:54:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.459+0000 7ff8aed9d700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff890060860 0x7ff890062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.459+0000 7ff8aed9d700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff890060860 0x7ff890062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006eef0 tx=0x7ff8a0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.463+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff8a804ef60 con 0x7ff8b0140910 2024-08-15T17:54:27.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.623+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8b00638f0 con 0x7ff8b0140910 2024-08-15T17:54:27.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8a6ffd700 1 -- 172.21.15.33:0/392717451 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8a802b020 con 0x7ff8b0140910 2024-08-15T17:54:27.627 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff890060860 msgr2=0x7ff890062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff890060860 0x7ff890062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006eef0 tx=0x7ff8a0007d50 comp rx=0 tx=0).stop 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 msgr2=0x7ff8b0156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 0x7ff8b0156890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8012950 tx=0x7ff8a8019000 comp rx=0 tx=0).stop 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 shutdown_connections 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff890060860 0x7ff890062d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b0140910 0x7ff8b0156890 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8b00cbf10 0x7ff8b0167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 --2- 172.21.15.33:0/392717451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8b00cbab0 0x7ff8b00a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 >> 172.21.15.33:0/392717451 conn(0x7ff8b00cdee0 msgr2=0x7ff8b00b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 shutdown_connections 2024-08-15T17:54:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.627+0000 7ff8b4a57700 1 -- 172.21.15.33:0/392717451 wait complete. 2024-08-15T17:54:27.643 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 Processor -- start 2024-08-15T17:54:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 -- start start 2024-08-15T17:54:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b040c90b0 0x7f7b040cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040ca7c0 con 0x7f7b040c7c60 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040c9530 con 0x7f7b040c90b0 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b09d8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040ae1a0 con 0x7f7b040c8030 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b02ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b03fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b040c90b0 0x7f7b040cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b037fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7b040c7c60 0x7f7b040ca0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:41152/0 (socket says 172.21.15.33:41152) 2024-08-15T17:54:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b037fe700 1 -- 172.21.15.33:0/1793812373 learned_addr learned my addr 172.21.15.33:0/1793812373 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b027fc700 1 -- 172.21.15.33:0/1793812373 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393002423 0 0) 0x7f7b040ca7c0 con 0x7f7b040c7c60 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b027fc700 1 -- 172.21.15.33:0/1793812373 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af0003570 con 0x7f7b040c7c60 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b02ffd700 1 -- 172.21.15.33:0/1793812373 >> v2:172.21.15.105:3300/0 conn(0x7f7b040c90b0 msgr2=0x7f7b040cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b02ffd700 1 --2- 172.21.15.33:0/1793812373 >> v2:172.21.15.105:3300/0 conn(0x7f7b040c90b0 0x7f7b040cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b02ffd700 1 -- 172.21.15.33:0/1793812373 >> v1:172.21.15.105:6789/0 conn(0x7f7b040c7c60 legacy=0x7f7b040ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b02ffd700 1 -- 172.21.15.33:0/1793812373 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040ae480 con 0x7f7b040c8030 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.751+0000 7f7b03fff700 1 --2- 172.21.15.33:0/1793812373 >> v2:172.21.15.105:3300/0 conn(0x7f7b040c90b0 0x7f7b040cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b02ffd700 1 --2- 172.21.15.33:0/1793812373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c8b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009e60 tx=0x7f7af4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3cf4f16af68b958 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b027fc700 1 -- 172.21.15.33:0/1793812373 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400e070 con 0x7f7b040c8030 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b027fc700 1 -- 172.21.15.33:0/1793812373 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400bab0 con 0x7f7b040c8030 2024-08-15T17:54:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b027fc700 1 -- 172.21.15.33:0/1793812373 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400be70 con 0x7f7b040c8030 2024-08-15T17:54:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 -- 172.21.15.33:0/1793812373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 msgr2=0x7f7b040c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/1793812373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c8b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009e60 tx=0x7f7af4009780 comp rx=0 tx=0).stop 2024-08-15T17:54:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 -- 172.21.15.33:0/1793812373 shutdown_connections 2024-08-15T17:54:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/1793812373 >> v2:172.21.15.105:3300/0 conn(0x7f7b040c90b0 0x7f7b040cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/1793812373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c8b70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 -- 172.21.15.33:0/1793812373 >> 172.21.15.33:0/1793812373 conn(0x7f7b040cd9d0 msgr2=0x7f7b040c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 -- 172.21.15.33:0/1793812373 shutdown_connections 2024-08-15T17:54:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.755+0000 7f7b09d8e700 1 -- 172.21.15.33:0/1793812373 wait complete. 2024-08-15T17:54:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 Processor -- start 2024-08-15T17:54:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 -- start start 2024-08-15T17:54:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 0x7f7b04157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b040c90b0 0x7f7b040c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040ac7c0 con 0x7f7b040c7c60 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040c67e0 con 0x7f7b040c90b0 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041581d0 con 0x7f7b040c8030 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 0x7f7b04157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 0x7f7b04157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46754/0 (socket says 172.21.15.33:46754) 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 -- 172.21.15.33:0/3750459035 learned_addr learned my addr 172.21.15.33:0/3750459035 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b02ffd700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b03fff700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b040c90b0 0x7f7b040c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 -- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 msgr2=0x7f7b040c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 -- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b040c90b0 msgr2=0x7f7b040c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b040c90b0 0x7f7b040c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 -- 172.21.15.33:0/3750459035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec009420 con 0x7f7b040c7c60 2024-08-15T17:54:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b03fff700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b040c90b0 0x7f7b040c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b037fe700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 0x7f7b04157c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00c820 tx=0x7f7afc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc005b30 con 0x7f7b040c7c60 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc005c90 con 0x7f7b040c7c60 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af4009a20 con 0x7f7b040c7c60 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.759+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc007320 con 0x7f7b040c7c60 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.763+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b040c5eb0 con 0x7f7b040c7c60 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.763+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040645c0 con 0x7f7b040c7c60 2024-08-15T17:54:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.763+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7afc01b3b0 con 0x7f7b040c7c60 2024-08-15T17:54:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.763+0000 7f7afb7fe700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7ae4060860 0x7f7ae4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.763+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7afc07c220 con 0x7f7b040c7c60 2024-08-15T17:54:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.763+0000 7f7b02ffd700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7ae4060860 0x7f7ae4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.767+0000 7f7b02ffd700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7ae4060860 0x7f7ae4062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7af40097c0 tx=0x7f7af4019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:27.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.771+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7afc04c670 con 0x7f7b040c7c60 2024-08-15T17:54:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.967+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b040cc7c0 con 0x7f7b040c7c60 2024-08-15T17:54:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.967+0000 7f7afb7fe700 1 -- 172.21.15.33:0/3750459035 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f7afc04fc90 con 0x7f7b040c7c60 2024-08-15T17:54:27.970 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:27.970 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7ae4060860 msgr2=0x7f7ae4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7ae4060860 0x7f7ae4062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7af40097c0 tx=0x7f7af4019000 comp rx=0 tx=0).stop 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 msgr2=0x7f7b04157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 0x7f7b04157c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00c820 tx=0x7f7afc007e00 comp rx=0 tx=0).stop 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 shutdown_connections 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7ae4060860 0x7f7ae4062d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b040c90b0 0x7f7b040c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b040c8030 0x7f7b040c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 --2- 172.21.15.33:0/3750459035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040c7c60 0x7f7b04157c90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:27.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 >> 172.21.15.33:0/3750459035 conn(0x7f7b040cd9d0 msgr2=0x7f7b0406ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:27.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 shutdown_connections 2024-08-15T17:54:27.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:27.971+0000 7f7b09d8e700 1 -- 172.21.15.33:0/3750459035 wait complete. 2024-08-15T17:54:27.974 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:27.985 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:28.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.087+0000 7fa1027d8700 1 Processor -- start 2024-08-15T17:54:28.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.087+0000 7fa1027d8700 1 -- start start 2024-08-15T17:54:28.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.087+0000 7fa1027d8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa0fc06e620 0x7fa0fc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.087+0000 7fa1027d8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc141a00 con 0x7fa0fc0b1630 2024-08-15T17:54:28.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.087+0000 7fa1027d8700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc140b10 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.087+0000 7fa1027d8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc140df0 con 0x7fa0fc06e620 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa101fd7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa0fc0b1630 0x7fa0fc141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60656/0 (socket says 172.21.15.33:60656) 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa101fd7700 1 -- 172.21.15.33:0/1421451950 learned_addr learned my addr 172.21.15.33:0/1421451950 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa100fd5700 1 --2- 172.21.15.33:0/1421451950 >> v2:172.21.15.105:3300/0 conn(0x7fa0fc06e620 0x7fa0fc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709699908 0 0) 0x7fa0fc141a00 con 0x7fa0fc0b1630 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e8003570 con 0x7fa0fc0b1630 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376030253 0 0) 0x7fa0fc140b10 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0fc141a00 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa100fd5700 1 -- 172.21.15.33:0/1421451950 >> v1:172.21.15.105:6789/0 conn(0x7fa0fc0b0d20 legacy=0x7fa0fc06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 319156559 0 0) 0x7fa0e8003570 con 0x7fa0fc0b1630 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa100fd5700 1 -- 172.21.15.33:0/1421451950 >> v1:172.21.15.33:6789/0 conn(0x7fa0fc0b1630 legacy=0x7fa0fc141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa100fd5700 1 -- 172.21.15.33:0/1421451950 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc1410d0 con 0x7fa0fc06e620 2024-08-15T17:54:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa100fd5700 1 --2- 172.21.15.33:0/1421451950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc06e620 0x7fa0fc0b10f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0098e0 tx=0x7fa0ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc7b23d67ef2f49f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8001470 con 0x7fa0fc06e620 2024-08-15T17:54:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec011420 con 0x7fa0fc06e620 2024-08-15T17:54:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa0f3fff700 1 -- 172.21.15.33:0/1421451950 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0117a0 con 0x7fa0fc06e620 2024-08-15T17:54:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 -- 172.21.15.33:0/1421451950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc06e620 msgr2=0x7fa0fc0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 --2- 172.21.15.33:0/1421451950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc06e620 0x7fa0fc0b10f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0098e0 tx=0x7fa0ec0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 -- 172.21.15.33:0/1421451950 shutdown_connections 2024-08-15T17:54:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 --2- 172.21.15.33:0/1421451950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc06e620 0x7fa0fc0b10f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 -- 172.21.15.33:0/1421451950 >> 172.21.15.33:0/1421451950 conn(0x7fa0fc0678d0 msgr2=0x7fa0fc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 -- 172.21.15.33:0/1421451950 shutdown_connections 2024-08-15T17:54:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.091+0000 7fa1027d8700 1 -- 172.21.15.33:0/1421451950 wait complete. 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 Processor -- start 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 -- start start 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0fc06e620 0x7fa0fc0a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 0x7fa0fc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc0b1630 0x7fa0fc06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc16e880 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc0a9830 con 0x7fa0fc0b1630 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc16e230 con 0x7fa0fc06e620 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 0x7fa0fc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa101fd7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc0b1630 0x7fa0fc06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1017d6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0fc06e620 0x7fa0fc0a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 0x7fa0fc069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59640/0 (socket says 172.21.15.33:59640) 2024-08-15T17:54:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa101fd7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc0b1630 0x7fa0fc06a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:37212/0 (socket says 172.21.15.33:37212) 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 -- 172.21.15.33:0/2428538436 learned_addr learned my addr 172.21.15.33:0/2428538436 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1017d6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0fc06e620 0x7fa0fc0a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:42186/0 (socket says 172.21.15.33:42186) 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 -- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0fc06e620 msgr2=0x7fa0fc0a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0fc06e620 0x7fa0fc0a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 -- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc0b1630 msgr2=0x7fa0fc06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc0b1630 0x7fa0fc06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 -- 172.21.15.33:0/2428538436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009420 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa100fd5700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 0x7fa0fc069f10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc06c2d0 tx=0x7fa0ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec01cab0 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec01cc30 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc16e510 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec01a450 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.095+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc16ed10 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.099+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc16e6a0 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.099+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa0ec01a820 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.099+0000 7fa0f17fa700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa0e0060860 0x7fa0e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.099+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0ec07e3b0 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.099+0000 7fa1017d6700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa0e0060860 0x7fa0e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.099+0000 7fa1017d6700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa0e0060860 0x7fa0e0062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc15b590 tx=0x7fa0f4007f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.107+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa0ec04e800 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.271+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0fc0643a0 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa0f17fa700 1 -- 172.21.15.33:0/2428538436 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa0ec006cb0 con 0x7fa0fc0b0d20 2024-08-15T17:54:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:28.275 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:28.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa0e0060860 msgr2=0x7fa0e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa0e0060860 0x7fa0e0062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc15b590 tx=0x7fa0f4007f90 comp rx=0 tx=0).stop 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 msgr2=0x7fa0fc069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 0x7fa0fc069f10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc06c2d0 tx=0x7fa0ec016000 comp rx=0 tx=0).stop 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 shutdown_connections 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa0e0060860 0x7fa0e0062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0fc0b1630 0x7fa0fc06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0fc0b0d20 0x7fa0fc069f10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 --2- 172.21.15.33:0/2428538436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0fc06e620 0x7fa0fc0a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.275+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 >> 172.21.15.33:0/2428538436 conn(0x7fa0fc0678d0 msgr2=0x7fa0fc15dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.279+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 shutdown_connections 2024-08-15T17:54:28.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.279+0000 7fa1027d8700 1 -- 172.21.15.33:0/2428538436 wait complete. 2024-08-15T17:54:28.296 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-15T17:54:28.297 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:28.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 Processor -- start 2024-08-15T17:54:28.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 -- start start 2024-08-15T17:54:28.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f15340b0d20 0x7f153406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1534141a00 con 0x7f15340b1800 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153406e8a0 con 0x7f153406e450 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1534140b10 con 0x7f15340b0d20 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1533fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f15340b0d20 0x7f153406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1538d94700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f15340b1800 0x7f1534141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60658/0 (socket says 172.21.15.33:60658) 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1538d94700 1 -- 172.21.15.33:0/3414849616 learned_addr learned my addr 172.21.15.33:0/3414849616 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1533fff700 1 -- 172.21.15.33:0/3414849616 >> v1:172.21.15.105:6789/0 conn(0x7f153406e450 legacy=0x7f15340b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1533fff700 1 -- 172.21.15.33:0/3414849616 >> v1:172.21.15.33:6789/0 conn(0x7f15340b1800 legacy=0x7f1534141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1533fff700 1 -- 172.21.15.33:0/3414849616 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534140df0 con 0x7f15340b0d20 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1532ffd700 1 -- 172.21.15.33:0/3414849616 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522453495 0 0) 0x7f1534141a00 con 0x7f15340b1800 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1533fff700 1 --2- 172.21.15.33:0/3414849616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15340b0d20 0x7f153406df10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e60 tx=0x7f152c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d4376de7b7b507 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1532ffd700 1 -- 172.21.15.33:0/3414849616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00e070 con 0x7f15340b0d20 2024-08-15T17:54:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1532ffd700 1 -- 172.21.15.33:0/3414849616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c00bbf0 con 0x7f15340b0d20 2024-08-15T17:54:28.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1532ffd700 1 -- 172.21.15.33:0/3414849616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c012430 con 0x7f15340b0d20 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 -- 172.21.15.33:0/3414849616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15340b0d20 msgr2=0x7f153406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.407+0000 7f1539595700 1 --2- 172.21.15.33:0/3414849616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15340b0d20 0x7f153406df10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e60 tx=0x7f152c009780 comp rx=0 tx=0).stop 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- 172.21.15.33:0/3414849616 shutdown_connections 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 --2- 172.21.15.33:0/3414849616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15340b0d20 0x7f153406df10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- 172.21.15.33:0/3414849616 >> 172.21.15.33:0/3414849616 conn(0x7f15340678d0 msgr2=0x7f1534067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- 172.21.15.33:0/3414849616 shutdown_connections 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- 172.21.15.33:0/3414849616 wait complete. 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 Processor -- start 2024-08-15T17:54:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- start start 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 0x7f153413fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15340b0d20 0x7f1534146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15340b1800 0x7f1534142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534146ca0 con 0x7f153406e450 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153416da40 con 0x7f15340b0d20 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1533fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 0x7f153413fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1539595700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15340a55d0 con 0x7f15340b1800 2024-08-15T17:54:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1533fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 0x7f153413fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59658/0 (socket says 172.21.15.33:59658) 2024-08-15T17:54:28.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.411+0000 7f1533fff700 1 -- 172.21.15.33:0/1224175414 learned_addr learned my addr 172.21.15.33:0/1224175414 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f15337fe700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15340b0d20 0x7f1534146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1538d94700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15340b1800 0x7f1534142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1533fff700 1 -- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15340b1800 msgr2=0x7f1534142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1533fff700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15340b1800 0x7f1534142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1533fff700 1 -- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15340b0d20 msgr2=0x7f1534146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1533fff700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15340b0d20 0x7f1534146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1533fff700 1 -- 172.21.15.33:0/1224175414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c009a20 con 0x7f153406e450 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f15337fe700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15340b0d20 0x7f1534146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1538d94700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15340b1800 0x7f1534142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1533fff700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 0x7f153413fe50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f152c00b6c0 tx=0x7f152c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c012e80 con 0x7f153406e450 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c01e640 con 0x7f153406e450 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15340a58b0 con 0x7f153406e450 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c01ea00 con 0x7f153406e450 2024-08-15T17:54:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15340a5e70 con 0x7f153406e450 2024-08-15T17:54:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15340643a0 con 0x7f153406e450 2024-08-15T17:54:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f152c024070 con 0x7f153406e450 2024-08-15T17:54:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f151bfff700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1520060860 0x7f1520062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.415+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f152c07f650 con 0x7f153406e450 2024-08-15T17:54:28.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.419+0000 7f15337fe700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1520060860 0x7f1520062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.419+0000 7f15337fe700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1520060860 0x7f1520062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1528006fd0 tx=0x7f1528008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.423+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f152c04fb50 con 0x7f153406e450 2024-08-15T17:54:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.623+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f153406f5f0 con 0x7f153406e450 2024-08-15T17:54:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.623+0000 7f151bfff700 1 -- 172.21.15.33:0/1224175414 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f152c01edb0 con 0x7f153406e450 2024-08-15T17:54:28.624 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:28.624 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1520060860 msgr2=0x7f1520062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1520060860 0x7f1520062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1528006fd0 tx=0x7f1528008040 comp rx=0 tx=0).stop 2024-08-15T17:54:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 msgr2=0x7f153413fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 0x7f153413fe50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f152c00b6c0 tx=0x7f152c018000 comp rx=0 tx=0).stop 2024-08-15T17:54:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 shutdown_connections 2024-08-15T17:54:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1520060860 0x7f1520062d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15340b0d20 0x7f1534146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15340b1800 0x7f1534142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 --2- 172.21.15.33:0/1224175414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153406e450 0x7f153413fe50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 >> 172.21.15.33:0/1224175414 conn(0x7f15340678d0 msgr2=0x7f1534068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 shutdown_connections 2024-08-15T17:54:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.627+0000 7f1539595700 1 -- 172.21.15.33:0/1224175414 wait complete. 2024-08-15T17:54:28.630 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:28.643 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:28.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 Processor -- start 2024-08-15T17:54:28.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 -- start start 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 0x7fcef00ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcef00b00f0 0x7fcef0155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef00b0ad0 con 0x7fcef00b0540 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef00b0db0 con 0x7fcef00b00f0 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fcef53ee700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00b1090 con 0x7fcef00adf60 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 0x7fcef00ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceee7fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcef00b00f0 0x7fcef0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 0x7fcef00ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:42200/0 (socket says 172.21.15.33:42200) 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 -- 172.21.15.33:0/2553388166 learned_addr learned my addr 172.21.15.33:0/2553388166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceef7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcef00b0540 0x7fcef01591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:35522/0 (socket says 172.21.15.33:35522) 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 -- 172.21.15.33:0/2553388166 >> v2:172.21.15.105:3300/0 conn(0x7fcef00b00f0 msgr2=0x7fcef0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 --2- 172.21.15.33:0/2553388166 >> v2:172.21.15.105:3300/0 conn(0x7fcef00b00f0 0x7fcef0155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 -- 172.21.15.33:0/2553388166 >> v1:172.21.15.105:6789/0 conn(0x7fcef00b0540 legacy=0x7fcef01591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 -- 172.21.15.33:0/2553388166 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00c9c30 con 0x7fcef00adf60 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceeeffd700 1 --2- 172.21.15.33:0/2553388166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 0x7fcef00ae330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009f20 tx=0x7fcee8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98692a96df33fc87 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceedffb700 1 -- 172.21.15.33:0/2553388166 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800e070 con 0x7fcef00adf60 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceedffb700 1 -- 172.21.15.33:0/2553388166 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee800b9d0 con 0x7fcef00adf60 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.747+0000 7fceedffb700 1 -- 172.21.15.33:0/2553388166 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80092e0 con 0x7fcef00adf60 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- 172.21.15.33:0/2553388166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 msgr2=0x7fcef00ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2553388166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 0x7fcef00ae330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009f20 tx=0x7fcee8009840 comp rx=0 tx=0).stop 2024-08-15T17:54:28.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- 172.21.15.33:0/2553388166 shutdown_connections 2024-08-15T17:54:28.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2553388166 >> v2:172.21.15.105:3300/0 conn(0x7fcef00b00f0 0x7fcef0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2553388166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00adf60 0x7fcef00ae330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- 172.21.15.33:0/2553388166 >> 172.21.15.33:0/2553388166 conn(0x7fcef006e450 msgr2=0x7fcef0067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:28.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- 172.21.15.33:0/2553388166 shutdown_connections 2024-08-15T17:54:28.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- 172.21.15.33:0/2553388166 wait complete. 2024-08-15T17:54:28.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 Processor -- start 2024-08-15T17:54:28.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- start start 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef00adf60 0x7fcef00c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 0x7fcef00c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00b0540 0x7fcef0168bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00c8a20 con 0x7fcef00b00f0 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00c4420 con 0x7fcef00adf60 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fcef53ee700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00c4700 con 0x7fcef00b0540 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 0x7fcef00c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 0x7fcef00c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59666/0 (socket says 172.21.15.33:59666) 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 -- 172.21.15.33:0/2682715591 learned_addr learned my addr 172.21.15.33:0/2682715591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:28.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceef7fe700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00b0540 0x7fcef0168bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceeeffd700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef00adf60 0x7fcef00c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 -- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00b0540 msgr2=0x7fcef0168bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00b0540 0x7fcef0168bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 -- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef00adf60 msgr2=0x7fcef00c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef00adf60 0x7fcef00c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.751+0000 7fceee7fc700 1 -- 172.21.15.33:0/2682715591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009ae0 con 0x7fcef00b00f0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fceee7fc700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 0x7fcef00c3e40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fced800ec80 tx=0x7fced80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced800c850 con 0x7fcef00b00f0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced800c9b0 con 0x7fcef00b00f0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced800cd50 con 0x7fcef00b00f0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef00c49e0 con 0x7fcef00b00f0 2024-08-15T17:54:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef00c87f0 con 0x7fcef00b00f0 2024-08-15T17:54:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef00644b0 con 0x7fcef00b00f0 2024-08-15T17:54:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fced8013680 con 0x7fcef00b00f0 2024-08-15T17:54:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcee6ffd700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fced4060860 0x7fced4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fced807cdd0 con 0x7fcef00b00f0 2024-08-15T17:54:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.755+0000 7fceeeffd700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fced4060860 0x7fced4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:28.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.759+0000 7fceeeffd700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fced4060860 0x7fced4062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009880 tx=0x7fcee8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:28.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.767+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fced804d220 con 0x7fcef00b00f0 2024-08-15T17:54:28.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcef00afed0 con 0x7fcef00b00f0 2024-08-15T17:54:28.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcee6ffd700 1 -- 172.21.15.33:0/2682715591 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fced8050840 con 0x7fcef00b00f0 2024-08-15T17:54:28.972 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:28.972 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1029073840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1029073840},{"type":"v1","addr":"172.21.15.105:6835","nonce":1029073840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/1384195812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1384195812},{"type":"v1","addr":"172.21.15.33:6833","nonce":1384195812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/4255307201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":4255307201},{"type":"v1","addr":"172.21.15.105:6837","nonce":4255307201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:53:50.255551+0000","modified":"2024-08-15T17:53:52.911666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/3596173362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3596173362},{"type":"v1","addr":"172.21.15.33:6835","nonce":3596173362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-15T17:54:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fced4060860 msgr2=0x7fced4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fced4060860 0x7fced4062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009880 tx=0x7fcee8018000 comp rx=0 tx=0).stop 2024-08-15T17:54:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 msgr2=0x7fcef00c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 0x7fcef00c3e40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fced800ec80 tx=0x7fced80091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 shutdown_connections 2024-08-15T17:54:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fced4060860 0x7fced4062d10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef00b0540 0x7fcef0168bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcef00b00f0 0x7fcef00c3e40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 --2- 172.21.15.33:0/2682715591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef00adf60 0x7fcef00c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:28.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 >> 172.21.15.33:0/2682715591 conn(0x7fcef006e450 msgr2=0x7fcef00af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:28.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 shutdown_connections 2024-08-15T17:54:28.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:28.971+0000 7fcef53ee700 1 -- 172.21.15.33:0/2682715591 wait complete. 2024-08-15T17:54:28.978 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-15T17:54:28.986 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.091+0000 7fb5c3fff700 1 Processor -- start 2024-08-15T17:54:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.091+0000 7fb5c3fff700 1 -- start start 2024-08-15T17:54:29.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c4159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5c415a2d0 0x7fb5c4155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c40aeff0 con 0x7fb5c4068840 2024-08-15T17:54:29.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c4069070 con 0x7fb5c415a2d0 2024-08-15T17:54:29.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40b0350 con 0x7fb5c4068c10 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5c415a2d0 0x7fb5c4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5c415a2d0 0x7fb5c4155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59670/0 (socket says 172.21.15.33:59670) 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 -- 172.21.15.33:0/9901067 learned_addr learned my addr 172.21.15.33:0/9901067 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5bbfff700 1 --2- 172.21.15.33:0/9901067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c4159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 -- 172.21.15.33:0/9901067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 msgr2=0x7fb5c4159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 --2- 172.21.15.33:0/9901067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c4159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 -- 172.21.15.33:0/9901067 >> v1:172.21.15.105:6789/0 conn(0x7fb5c4068840 legacy=0x7fb5c40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 -- 172.21.15.33:0/9901067 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40af7d0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c37fe700 1 --2- 172.21.15.33:0/9901067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009f20 tx=0x7fb5bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5912d89a674e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c27fc700 1 -- 172.21.15.33:0/9901067 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00e070 con 0x7fb5c415a2d0 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c27fc700 1 -- 172.21.15.33:0/9901067 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc00ba40 con 0x7fb5c415a2d0 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c27fc700 1 -- 172.21.15.33:0/9901067 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0092e0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- 172.21.15.33:0/9901067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 msgr2=0x7fb5c4155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/9901067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009f20 tx=0x7fb5bc009840 comp rx=0 tx=0).stop 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- 172.21.15.33:0/9901067 shutdown_connections 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/9901067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155800 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/9901067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c4159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- 172.21.15.33:0/9901067 >> 172.21.15.33:0/9901067 conn(0x7fb5c406d800 msgr2=0x7fb5c406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- 172.21.15.33:0/9901067 shutdown_connections 2024-08-15T17:54:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.095+0000 7fb5c3fff700 1 -- 172.21.15.33:0/9901067 wait complete. 2024-08-15T17:54:29.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.099+0000 7fb5c3fff700 1 Processor -- start 2024-08-15T17:54:29.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.099+0000 7fb5c3fff700 1 -- start start 2024-08-15T17:54:29.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c4068840 0x7fb5c416cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c40c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c416da80 con 0x7fb5c415a2d0 2024-08-15T17:54:29.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40a8bb0 con 0x7fb5c4068840 2024-08-15T17:54:29.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c416d1e0 con 0x7fb5c4068c10 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c2ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c4068840 0x7fb5c416cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59684/0 (socket says 172.21.15.33:59684) 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 -- 172.21.15.33:0/3112104543 learned_addr learned my addr 172.21.15.33:0/3112104543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5bbfff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c40c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 -- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 msgr2=0x7fb5c40c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c40c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 -- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c4068840 msgr2=0x7fb5c416cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c4068840 0x7fb5c416cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 -- 172.21.15.33:0/3112104543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009ae0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c37fe700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b6c0 tx=0x7fb5bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0094e0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0032f0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc01d420 con 0x7fb5c415a2d0 2024-08-15T17:54:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c416d4c0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.103+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c41558b0 con 0x7fb5c415a2d0 2024-08-15T17:54:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.107+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c40b1030 con 0x7fb5c415a2d0 2024-08-15T17:54:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.107+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb5bc01d850 con 0x7fb5c415a2d0 2024-08-15T17:54:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.107+0000 7fb5baffd700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb5a4060860 0x7fb5a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.107+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5bc07e350 con 0x7fb5c415a2d0 2024-08-15T17:54:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.107+0000 7fb5c2ffd700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb5a4060860 0x7fb5a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.107+0000 7fb5c2ffd700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb5a4060860 0x7fb5a4062d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40039e0 tx=0x7fb5b4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.115+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb5c40b1030 con 0x7fb5c415a2d0 2024-08-15T17:54:29.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.279+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5c40b1030 con 0x7fb5c415a2d0 2024-08-15T17:54:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.283+0000 7fb5baffd700 1 -- 172.21.15.33:0/3112104543 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb5c40b1030 con 0x7fb5c415a2d0 2024-08-15T17:54:29.283 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:29.283 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:53:51.884464+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:53:48.060013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-15T17:53:49.231300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb5a4060860 msgr2=0x7fb5a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb5a4060860 0x7fb5a4062d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40039e0 tx=0x7fb5b4007ec0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 msgr2=0x7fb5c4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b6c0 tx=0x7fb5bc017000 comp rx=0 tx=0).stop 2024-08-15T17:54:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 shutdown_connections 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb5a4060860 0x7fb5a4062d10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c415a2d0 0x7fb5c4155370 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5c4068c10 0x7fb5c40c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 --2- 172.21.15.33:0/3112104543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c4068840 0x7fb5c416cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 >> 172.21.15.33:0/3112104543 conn(0x7fb5c406d800 msgr2=0x7fb5c41562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 shutdown_connections 2024-08-15T17:54:29.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.287+0000 7fb5c3fff700 1 -- 172.21.15.33:0/3112104543 wait complete. 2024-08-15T17:54:29.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-15T17:54:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.411+0000 7f5d473d6700 1 Processor -- start 2024-08-15T17:54:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- start start 2024-08-15T17:54:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5d4006e9d0 0x7f5d4006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5d400ab540 0x7f5d400b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400aba70 con 0x7f5d40155010 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400abd50 con 0x7f5d400ab540 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400ac030 con 0x7f5d4006e9d0 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d46bd5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5d40155010 0x7f5d40155490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60668/0 (socket says 172.21.15.33:60668) 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d46bd5700 1 -- 172.21.15.33:0/3296551688 learned_addr learned my addr 172.21.15.33:0/3296551688 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d45bd3700 1 --2- 172.21.15.33:0/3296551688 >> v2:172.21.15.33:3300/0 conn(0x7f5d400ab540 0x7f5d400b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d463d4700 1 --2- 172.21.15.33:0/3296551688 >> v2:172.21.15.105:3300/0 conn(0x7f5d4006e9d0 0x7f5d4006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d453d2700 1 -- 172.21.15.33:0/3296551688 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104417667 0 0) 0x7f5d400aba70 con 0x7f5d40155010 2024-08-15T17:54:29.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d453d2700 1 -- 172.21.15.33:0/3296551688 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d2c003570 con 0x7f5d40155010 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d45bd3700 1 -- 172.21.15.33:0/3296551688 >> v2:172.21.15.105:3300/0 conn(0x7f5d4006e9d0 msgr2=0x7f5d4006eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d45bd3700 1 --2- 172.21.15.33:0/3296551688 >> v2:172.21.15.105:3300/0 conn(0x7f5d4006e9d0 0x7f5d4006eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d45bd3700 1 -- 172.21.15.33:0/3296551688 >> v1:172.21.15.33:6789/0 conn(0x7f5d40155010 legacy=0x7f5d40155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d45bd3700 1 -- 172.21.15.33:0/3296551688 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400ac310 con 0x7f5d400ab540 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d45bd3700 1 --2- 172.21.15.33:0/3296551688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d400ab540 0x7f5d400b1320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d4006c910 tx=0x7f5d340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf6001a572bf245 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d453d2700 1 -- 172.21.15.33:0/3296551688 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34011630 con 0x7f5d400ab540 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d453d2700 1 -- 172.21.15.33:0/3296551688 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d340117b0 con 0x7f5d400ab540 2024-08-15T17:54:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d453d2700 1 -- 172.21.15.33:0/3296551688 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34011b70 con 0x7f5d400ab540 2024-08-15T17:54:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- 172.21.15.33:0/3296551688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d400ab540 msgr2=0x7f5d400b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 --2- 172.21.15.33:0/3296551688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d400ab540 0x7f5d400b1320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d4006c910 tx=0x7f5d340091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- 172.21.15.33:0/3296551688 shutdown_connections 2024-08-15T17:54:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 --2- 172.21.15.33:0/3296551688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d400ab540 0x7f5d400b1320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 --2- 172.21.15.33:0/3296551688 >> v2:172.21.15.105:3300/0 conn(0x7f5d4006e9d0 0x7f5d4006eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.415+0000 7f5d473d6700 1 -- 172.21.15.33:0/3296551688 >> 172.21.15.33:0/3296551688 conn(0x7f5d400678d0 msgr2=0x7f5d40067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:29.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 -- 172.21.15.33:0/3296551688 shutdown_connections 2024-08-15T17:54:29.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 -- 172.21.15.33:0/3296551688 wait complete. 2024-08-15T17:54:29.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 Processor -- start 2024-08-15T17:54:29.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 -- start start 2024-08-15T17:54:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d4006e9d0 0x7f5d40148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d400ab540 0x7f5d400c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 0x7f5d400c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400a9650 con 0x7f5d40155010 2024-08-15T17:54:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401501b0 con 0x7f5d400ab540 2024-08-15T17:54:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d473d6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400a7e80 con 0x7f5d4006e9d0 2024-08-15T17:54:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d46bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 0x7f5d400c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d46bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 0x7f5d400c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59700/0 (socket says 172.21.15.33:59700) 2024-08-15T17:54:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d45bd3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d400ab540 0x7f5d400c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d46bd5700 1 -- 172.21.15.33:0/1788016379 learned_addr learned my addr 172.21.15.33:0/1788016379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.419+0000 7f5d463d4700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d4006e9d0 0x7f5d40148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d46bd5700 1 -- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d4006e9d0 msgr2=0x7f5d40148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d46bd5700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d4006e9d0 0x7f5d40148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d46bd5700 1 -- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d400ab540 msgr2=0x7f5d400c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d46bd5700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d400ab540 0x7f5d400c1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d46bd5700 1 -- 172.21.15.33:0/1788016379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009420 con 0x7f5d40155010 2024-08-15T17:54:29.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d46bd5700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 0x7f5d400c1890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d38001460 tx=0x7f5d38001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800a870 con 0x7f5d40155010 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3800a9d0 con 0x7f5d40155010 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d400a8160 con 0x7f5d40155010 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800ad50 con 0x7f5d40155010 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d400a9b40 con 0x7f5d40155010 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d400a82f0 con 0x7f5d40155010 2024-08-15T17:54:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.423+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5d38007300 con 0x7f5d40155010 2024-08-15T17:54:29.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.427+0000 7f5d327fc700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5d24060860 0x7f5d24062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.427+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d3807cf50 con 0x7f5d40155010 2024-08-15T17:54:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.427+0000 7f5d463d4700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5d24060860 0x7f5d24062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.427+0000 7f5d463d4700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5d24060860 0x7f5d24062d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d400cafd0 tx=0x7f5d3c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.431+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5d3804d390 con 0x7f5d40155010 2024-08-15T17:54:29.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.627+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d400643a0 con 0x7f5d40155010 2024-08-15T17:54:29.629 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-08-15T17:54:29.627+0000 7f11dc36e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-15T17:54:29.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.635+0000 7f5d327fc700 1 -- 172.21.15.33:0/1788016379 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d380509b0 con 0x7f5d40155010 2024-08-15T17:54:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5d24060860 msgr2=0x7f5d24062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5d24060860 0x7f5d24062d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d400cafd0 tx=0x7f5d3c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 msgr2=0x7f5d400c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 0x7f5d400c1890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d38001460 tx=0x7f5d38001a40 comp rx=0 tx=0).stop 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 shutdown_connections 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5d24060860 0x7f5d24062d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d400ab540 0x7f5d400c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d40155010 0x7f5d400c1890 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 --2- 172.21.15.33:0/1788016379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d4006e9d0 0x7f5d40148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 >> 172.21.15.33:0/1788016379 conn(0x7f5d400678d0 msgr2=0x7f5d40069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 shutdown_connections 2024-08-15T17:54:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.643+0000 7f5d473d6700 1 -- 172.21.15.33:0/1788016379 wait complete. 2024-08-15T17:54:29.644 INFO:tasks.ceph.mds.a.smithi033.stderr: -2389> 2024-08-15T17:53:53.555+0000 7fdc654f6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-15T17:54:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-15T17:54:29.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-15T17:54:29.669 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-08-15T17:54:29.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.755+0000 7f229b534700 1 Processor -- start 2024-08-15T17:54:29.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.755+0000 7f229b534700 1 -- start start 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294155d60 0x7f22940c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2294068db0 0x7f2294156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940c94c0 con 0x7f2294156130 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229406e9c0 con 0x7f2294068db0 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294157c30 con 0x7f2294155d60 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2294068db0 0x7f2294156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2294068db0 0x7f2294156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59714/0 (socket says 172.21.15.33:59714) 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 -- 172.21.15.33:0/3765326620 learned_addr learned my addr 172.21.15.33:0/3765326620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229a532700 1 --2- 172.21.15.33:0/3765326620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294155d60 0x7f22940c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 -- 172.21.15.33:0/3765326620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294155d60 msgr2=0x7f22940c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 --2- 172.21.15.33:0/3765326620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294155d60 0x7f22940c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 -- 172.21.15.33:0/3765326620 >> v1:172.21.15.105:6789/0 conn(0x7f2294156130 legacy=0x7f22940686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 -- 172.21.15.33:0/3765326620 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294157f10 con 0x7f2294068db0 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229ad33700 1 --2- 172.21.15.33:0/3765326620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294068db0 0x7f2294156ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f228c009f20 tx=0x7f228c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955a545f654ba6d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f2299530700 1 -- 172.21.15.33:0/3765326620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00e070 con 0x7f2294068db0 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f2299530700 1 -- 172.21.15.33:0/3765326620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00b9d0 con 0x7f2294068db0 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f2299530700 1 -- 172.21.15.33:0/3765326620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0092e0 con 0x7f2294068db0 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- 172.21.15.33:0/3765326620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294068db0 msgr2=0x7f2294156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 --2- 172.21.15.33:0/3765326620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294068db0 0x7f2294156ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f228c009f20 tx=0x7f228c009840 comp rx=0 tx=0).stop 2024-08-15T17:54:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- 172.21.15.33:0/3765326620 shutdown_connections 2024-08-15T17:54:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 --2- 172.21.15.33:0/3765326620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294068db0 0x7f2294156ff0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 --2- 172.21.15.33:0/3765326620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294155d60 0x7f22940c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- 172.21.15.33:0/3765326620 >> 172.21.15.33:0/3765326620 conn(0x7f22940ccfc0 msgr2=0x7f229406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- 172.21.15.33:0/3765326620 shutdown_connections 2024-08-15T17:54:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.759+0000 7f229b534700 1 -- 172.21.15.33:0/3765326620 wait complete. 2024-08-15T17:54:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 Processor -- start 2024-08-15T17:54:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 -- start start 2024-08-15T17:54:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2294068db0 0x7f2294144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 0x7f22940af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294156130 0x7f22940afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294141c90 con 0x7f2294155d60 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294143a10 con 0x7f2294068db0 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f229b534700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294143cf0 con 0x7f2294156130 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.763+0000 7f2299d31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 0x7f22940af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 0x7f22940af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59720/0 (socket says 172.21.15.33:59720) 2024-08-15T17:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 -- 172.21.15.33:0/1160834333 learned_addr learned my addr 172.21.15.33:0/1160834333 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f229a532700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2294068db0 0x7f2294144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f229ad33700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294156130 0x7f22940afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 -- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294156130 msgr2=0x7f22940afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294156130 0x7f22940afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 -- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2294068db0 msgr2=0x7f2294144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2294068db0 0x7f2294144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 -- 172.21.15.33:0/1160834333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009ae0 con 0x7f2294155d60 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f2299d31700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 0x7f22940af560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f228400c4e0 tx=0x7f228400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284011590 con 0x7f2294155d60 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2284011710 con 0x7f2294155d60 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2294143fd0 con 0x7f2294155d60 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284011ad0 con 0x7f2294155d60 2024-08-15T17:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2294144590 con 0x7f2294155d60 2024-08-15T17:54:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.767+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22940638f0 con 0x7f2294155d60 2024-08-15T17:54:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.771+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f228401b3b0 con 0x7f2294155d60 2024-08-15T17:54:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.771+0000 7f228a7fc700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2278060860 0x7f2278062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.771+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f228407bf70 con 0x7f2294155d60 2024-08-15T17:54:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.771+0000 7f229a532700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2278060860 0x7f2278062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.771+0000 7f229a532700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2278060860 0x7f2278062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2290009db0 tx=0x7f22900091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:29.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.779+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f228404c370 con 0x7f2294155d60 2024-08-15T17:54:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:29.983+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f22940caf80 con 0x7f2294155d60 2024-08-15T17:54:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.647+0000 7f228a7fc700 1 -- 172.21.15.33:0/1160834333 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f228404f990 con 0x7f2294155d60 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2278060860 msgr2=0x7f2278062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2278060860 0x7f2278062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2290009db0 tx=0x7f22900091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 msgr2=0x7f22940af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 0x7f22940af560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f228400c4e0 tx=0x7f228400c7f0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 shutdown_connections 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2278060860 0x7f2278062d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2294156130 0x7f22940afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2294155d60 0x7f22940af560 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f228400c4e0 tx=0x7f228400c7f0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 --2- 172.21.15.33:0/1160834333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2294068db0 0x7f2294144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 >> 172.21.15.33:0/1160834333 conn(0x7f22940ccfc0 msgr2=0x7f229406b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 shutdown_connections 2024-08-15T17:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.651+0000 7f229b534700 1 -- 172.21.15.33:0/1160834333 wait complete. 2024-08-15T17:54:30.666 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-15T17:54:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 Processor -- start 2024-08-15T17:54:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 -- start start 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d0155f90 0x7f27d00c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27d00c8c00 0x7f27d00686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00ac470 con 0x7f27d0156360 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00ab860 con 0x7f27d00c8c00 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.787+0000 7f27d6b8f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00abb40 con 0x7f27d0155f90 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27d00c8c00 0x7f27d00686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27d00c8c00 0x7f27d00686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59734/0 (socket says 172.21.15.33:59734) 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27cffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f27d0156360 0x7f27d00ac900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60672/0 (socket says 172.21.15.33:60672) 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 -- 172.21.15.33:0/4258027835 learned_addr learned my addr 172.21.15.33:0/4258027835 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d492b700 1 --2- 172.21.15.33:0/4258027835 >> v2:172.21.15.105:3300/0 conn(0x7f27d0155f90 0x7f27d00c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 -- 172.21.15.33:0/4258027835 >> v2:172.21.15.105:3300/0 conn(0x7f27d0155f90 msgr2=0x7f27d00c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 --2- 172.21.15.33:0/4258027835 >> v2:172.21.15.105:3300/0 conn(0x7f27d0155f90 0x7f27d00c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 -- 172.21.15.33:0/4258027835 >> v1:172.21.15.33:6789/0 conn(0x7f27d0156360 legacy=0x7f27d00ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 -- 172.21.15.33:0/4258027835 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00abe20 con 0x7f27d00c8c00 2024-08-15T17:54:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d512c700 1 --2- 172.21.15.33:0/4258027835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d00c8c00 0x7f27d00686a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f27d00694e0 tx=0x7f27c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34fb4d01e947fd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:30.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27cf7fe700 1 -- 172.21.15.33:0/4258027835 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e070 con 0x7f27d00c8c00 2024-08-15T17:54:30.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27cf7fe700 1 -- 172.21.15.33:0/4258027835 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800bae0 con 0x7f27d00c8c00 2024-08-15T17:54:30.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27cf7fe700 1 -- 172.21.15.33:0/4258027835 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80092e0 con 0x7f27d00c8c00 2024-08-15T17:54:30.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4258027835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d00c8c00 msgr2=0x7f27d00686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:30.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4258027835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d00c8c00 0x7f27d00686a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f27d00694e0 tx=0x7f27c8009840 comp rx=0 tx=0).stop 2024-08-15T17:54:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4258027835 shutdown_connections 2024-08-15T17:54:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4258027835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d00c8c00 0x7f27d00686a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4258027835 >> v2:172.21.15.105:3300/0 conn(0x7f27d0155f90 0x7f27d00c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4258027835 >> 172.21.15.33:0/4258027835 conn(0x7f27d006d9f0 msgr2=0x7f27d006ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4258027835 shutdown_connections 2024-08-15T17:54:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.791+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4258027835 wait complete. 2024-08-15T17:54:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 Processor -- start 2024-08-15T17:54:30.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 -- start start 2024-08-15T17:54:30.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00c8c00 0x7f27d015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:30.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 0x7f27d0159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:30.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d015a100 0x7f27d0166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:30.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d015b270 con 0x7f27d0155f90 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d015a660 con 0x7f27d015a100 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d6b8f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d015a940 con 0x7f27d00c8c00 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 0x7f27d0159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 0x7f27d0159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59736/0 (socket says 172.21.15.33:59736) 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27cffff700 1 -- 172.21.15.33:0/4013510019 learned_addr learned my addr 172.21.15.33:0/4013510019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d512c700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d015a100 0x7f27d0166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.795+0000 7f27d492b700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00c8c00 0x7f27d015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27cffff700 1 -- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00c8c00 msgr2=0x7f27d015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27cffff700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00c8c00 0x7f27d015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27cffff700 1 -- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d015a100 msgr2=0x7f27d0166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27cffff700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d015a100 0x7f27d0166380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:30.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27cffff700 1 -- 172.21.15.33:0/4013510019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009ae0 con 0x7f27d0155f90 2024-08-15T17:54:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27cffff700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 0x7f27d0159bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c560 tx=0x7f27c4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4005a70 con 0x7f27d0155f90 2024-08-15T17:54:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4005bd0 con 0x7f27d0155f90 2024-08-15T17:54:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d015ac20 con 0x7f27d0155f90 2024-08-15T17:54:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40070d0 con 0x7f27d0155f90 2024-08-15T17:54:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0158710 con 0x7f27d0155f90 2024-08-15T17:54:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d015b420 con 0x7f27d0155f90 2024-08-15T17:54:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f27c4007480 con 0x7f27d0155f90 2024-08-15T17:54:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.799+0000 7f27ccff9700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f27bc060860 0x7f27bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.803+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f27c407e940 con 0x7f27d0155f90 2024-08-15T17:54:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.803+0000 7f27d492b700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f27bc060860 0x7f27bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.803+0000 7f27d492b700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f27bc060860 0x7f27bc062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006fd0 tx=0x7f27c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.811+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f27d015b420 con 0x7f27d0155f90 2024-08-15T17:54:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:30.979+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27d00638f0 con 0x7f27d0155f90 2024-08-15T17:54:31.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.651+0000 7f27ccff9700 1 -- 172.21.15.33:0/4013510019 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f27c40150d0 con 0x7f27d0155f90 2024-08-15T17:54:31.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.663+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f27bc060860 msgr2=0x7f27bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:31.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.663+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f27bc060860 0x7f27bc062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006fd0 tx=0x7f27c0008040 comp rx=0 tx=0).stop 2024-08-15T17:54:31.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.663+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 msgr2=0x7f27d0159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:31.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.663+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 0x7f27d0159bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c560 tx=0x7f27c4007f70 comp rx=0 tx=0).stop 2024-08-15T17:54:31.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 shutdown_connections 2024-08-15T17:54:31.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f27bc060860 0x7f27bc062d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d015a100 0x7f27d0166380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27d0155f90 0x7f27d0159bc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 --2- 172.21.15.33:0/4013510019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00c8c00 0x7f27d015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 >> 172.21.15.33:0/4013510019 conn(0x7f27d006d9f0 msgr2=0x7f27d0067670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:31.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 shutdown_connections 2024-08-15T17:54:31.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.667+0000 7f27d6b8f700 1 -- 172.21.15.33:0/4013510019 wait complete. 2024-08-15T17:54:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-08-15T17:54:31.682 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-15T17:54:31.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.791+0000 7f7712a58700 1 Processor -- start 2024-08-15T17:54:31.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.791+0000 7f7712a58700 1 -- start start 2024-08-15T17:54:31.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f770c15b210 0x7f770c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:31.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 0x7f770c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:31.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0cd230 con 0x7f770c140800 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0b0fb0 con 0x7f770c15b210 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0b03a0 con 0x7f770c140bd0 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 0x7f770c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7711255700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f770c15b210 0x7f770c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 0x7f770c0cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:42264/0 (socket says 172.21.15.33:42264) 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 -- 172.21.15.33:0/109343498 learned_addr learned my addr 172.21.15.33:0/109343498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:31.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7711a56700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f770c140800 0x7f770c15ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:35566/0 (socket says 172.21.15.33:35566) 2024-08-15T17:54:31.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 -- 172.21.15.33:0/109343498 >> v2:172.21.15.105:3300/0 conn(0x7f770c15b210 msgr2=0x7f770c0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:31.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 --2- 172.21.15.33:0/109343498 >> v2:172.21.15.105:3300/0 conn(0x7f770c15b210 0x7f770c0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 -- 172.21.15.33:0/109343498 >> v1:172.21.15.105:6789/0 conn(0x7f770c140800 legacy=0x7f770c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 -- 172.21.15.33:0/109343498 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0afb00 con 0x7f770c140bd0 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7711255700 1 --2- 172.21.15.33:0/109343498 >> v2:172.21.15.105:3300/0 conn(0x7f770c15b210 0x7f770c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712257700 1 --2- 172.21.15.33:0/109343498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 0x7f770c0cccf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7704009f20 tx=0x7f7704009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d6e5b641aab48ce server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7710a54700 1 -- 172.21.15.33:0/109343498 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400e070 con 0x7f770c140bd0 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7710a54700 1 -- 172.21.15.33:0/109343498 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400b9d0 con 0x7f770c140bd0 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7710a54700 1 -- 172.21.15.33:0/109343498 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040092e0 con 0x7f770c140bd0 2024-08-15T17:54:31.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 -- 172.21.15.33:0/109343498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 msgr2=0x7f770c0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:31.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.795+0000 7f7712a58700 1 --2- 172.21.15.33:0/109343498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 0x7f770c0cccf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7704009f20 tx=0x7f7704009840 comp rx=0 tx=0).stop 2024-08-15T17:54:31.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- 172.21.15.33:0/109343498 shutdown_connections 2024-08-15T17:54:31.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 --2- 172.21.15.33:0/109343498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c140bd0 0x7f770c0cccf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 --2- 172.21.15.33:0/109343498 >> v2:172.21.15.105:3300/0 conn(0x7f770c15b210 0x7f770c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- 172.21.15.33:0/109343498 >> 172.21.15.33:0/109343498 conn(0x7f770c06cd20 msgr2=0x7f770c06d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:31.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- 172.21.15.33:0/109343498 shutdown_connections 2024-08-15T17:54:31.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- 172.21.15.33:0/109343498 wait complete. 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 Processor -- start 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- start start 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c140800 0x7f770c169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 0x7f770c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c15b210 0x7f770c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c8950 con 0x7f770c140bd0 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c7d40 con 0x7f770c140800 2024-08-15T17:54:31.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.799+0000 7f7712a58700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c8020 con 0x7f770c15b210 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 0x7f770c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 0x7f770c1563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59748/0 (socket says 172.21.15.33:59748) 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 -- 172.21.15.33:0/554470316 learned_addr learned my addr 172.21.15.33:0/554470316 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711a56700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c140800 0x7f770c169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7712257700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c15b210 0x7f770c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 -- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c15b210 msgr2=0x7f770c0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c15b210 0x7f770c0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 -- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c140800 msgr2=0x7f770c169320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c140800 0x7f770c169320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 -- 172.21.15.33:0/554470316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009420 con 0x7f770c140bd0 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7712257700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c15b210 0x7f770c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711a56700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c140800 0x7f770c169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:31.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7711255700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 0x7f770c1563d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f770000ec80 tx=0x7f77000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:31.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000c9d0 con 0x7f770c140bd0 2024-08-15T17:54:31.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770000cb30 con 0x7f770c140bd0 2024-08-15T17:54:31.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7704009ae0 con 0x7f770c140bd0 2024-08-15T17:54:31.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700013470 con 0x7f770c140bd0 2024-08-15T17:54:31.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0c83b0 con 0x7f770c140bd0 2024-08-15T17:54:31.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0cd090 con 0x7f770c140bd0 2024-08-15T17:54:31.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.803+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7700013820 con 0x7f770c140bd0 2024-08-15T17:54:31.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.807+0000 7f76fdffb700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f76f0060860 0x7f76f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:31.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.807+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f770007d210 con 0x7f770c140bd0 2024-08-15T17:54:31.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.807+0000 7f7711a56700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f76f0060860 0x7f76f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:31.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.807+0000 7f7711a56700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f76f0060860 0x7f76f0062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7708007fd0 tx=0x7f7708007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:31.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.815+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f770004d780 con 0x7f770c140bd0 2024-08-15T17:54:31.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:31.983+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f770c0cd090 con 0x7f770c140bd0 2024-08-15T17:54:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.659+0000 7f76fdffb700 1 -- 172.21.15.33:0/554470316 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f770c0cd090 con 0x7f770c140bd0 2024-08-15T17:54:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f76f0060860 msgr2=0x7f76f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f76f0060860 0x7f76f0062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7708007fd0 tx=0x7f7708007e10 comp rx=0 tx=0).stop 2024-08-15T17:54:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 msgr2=0x7f770c1563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 0x7f770c1563d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f770000ec80 tx=0x7f77000091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 shutdown_connections 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f76f0060860 0x7f76f0062d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f770c15b210 0x7f770c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f770c140bd0 0x7f770c1563d0 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f770000ec80 tx=0x7f77000091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 --2- 172.21.15.33:0/554470316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c140800 0x7f770c169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 >> 172.21.15.33:0/554470316 conn(0x7f770c06cd20 msgr2=0x7f770c0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 shutdown_connections 2024-08-15T17:54:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.667+0000 7f7712a58700 1 -- 172.21.15.33:0/554470316 wait complete. 2024-08-15T17:54:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-08-15T17:54:32.684 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-15T17:54:32.684 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-15T17:54:32.684 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-15T17:54:32.684 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:54:32.684 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-15T17:54:32.685 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-15T17:54:32.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-15T17:54:32.685 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:54:32.685 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-15T17:54:32.685 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-15T17:54:32.685 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-15T17:54:32.685 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:54:32.685 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-15T17:54:32.686 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-15T17:54:32.686 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-15T17:54:32.686 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:54:32.695 INFO:tasks.ceph.mds.a:Stopped 2024-08-15T17:54:32.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-15T17:54:32.697 INFO:tasks.ceph.mds.c:Stopped 2024-08-15T17:54:32.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-15T17:54:32.698 INFO:tasks.ceph.mds.a:Started 2024-08-15T17:54:32.699 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:32.700 INFO:tasks.ceph.mds.d:Stopped 2024-08-15T17:54:32.700 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-15T17:54:32.701 INFO:tasks.ceph.mds.b:Stopped 2024-08-15T17:54:32.701 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-15T17:54:32.702 INFO:tasks.ceph.mds.c:Started 2024-08-15T17:54:32.702 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:32.703 INFO:tasks.ceph.mds.d:Started 2024-08-15T17:54:32.703 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:32.704 INFO:tasks.ceph.mds.b:Started 2024-08-15T17:54:32.705 DEBUG:teuthology.parallel:result is None 2024-08-15T17:54:32.705 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-15T17:54:32.779 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-08-15T17:54:32.779 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-08-15T17:54:32.779 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-08-15T17:54:32.782 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-08-15T17:54:32.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.819+0000 7f2d88b3f700 1 Processor -- start 2024-08-15T17:54:32.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.819+0000 7f2d88b3f700 1 -- start start 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d841593b0 0x7f2d8415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840acae0 con 0x7f2d840aab50 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840ac650 con 0x7f2d8415a8b0 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84159780 con 0x7f2d841593b0 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d82d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2d840aab50 0x7f2d840b0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60688/0 (socket says 172.21.15.33:60688) 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d82d9d700 1 -- 172.21.15.33:0/1614316215 learned_addr learned my addr 172.21.15.33:0/1614316215 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:32.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8259c700 1 --2- 172.21.15.33:0/1614316215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d841593b0 0x7f2d8415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:32.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421143228 0 0) 0x7f2d840acae0 con 0x7f2d840aab50 2024-08-15T17:54:32.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d70003570 con 0x7f2d840aab50 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862184267 0 0) 0x7f2d840ac650 con 0x7f2d8415a8b0 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d840acae0 con 0x7f2d8415a8b0 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8259c700 1 -- 172.21.15.33:0/1614316215 >> v1:172.21.15.105:6789/0 conn(0x7f2d8415a8b0 legacy=0x7f2d840aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8259c700 1 -- 172.21.15.33:0/1614316215 >> v1:172.21.15.33:6789/0 conn(0x7f2d840aab50 legacy=0x7f2d840b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8259c700 1 -- 172.21.15.33:0/1614316215 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840aba40 con 0x7f2d841593b0 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8259c700 1 --2- 172.21.15.33:0/1614316215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d841593b0 0x7f2d8415a370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009910 tx=0x7f2d6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea52cc581aac1ec server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011630 con 0x7f2d841593b0 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c011790 con 0x7f2d841593b0 2024-08-15T17:54:32.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d8159a700 1 -- 172.21.15.33:0/1614316215 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011b10 con 0x7f2d841593b0 2024-08-15T17:54:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1614316215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d841593b0 msgr2=0x7f2d8415a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1614316215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d841593b0 0x7f2d8415a370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009910 tx=0x7f2d6c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1614316215 shutdown_connections 2024-08-15T17:54:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1614316215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d841593b0 0x7f2d8415a370 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1614316215 >> 172.21.15.33:0/1614316215 conn(0x7f2d84068300 msgr2=0x7f2d840a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1614316215 shutdown_connections 2024-08-15T17:54:32.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.823+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1614316215 wait complete. 2024-08-15T17:54:32.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 Processor -- start 2024-08-15T17:54:32.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 -- start start 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d840aab50 0x7f2d8414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 0x7f2d84098340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d8415a8b0 0x7f2d84098880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840c5950 con 0x7f2d841593b0 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414df40 con 0x7f2d8415a8b0 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840afd30 con 0x7f2d840aab50 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 0x7f2d84098340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:32.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 0x7f2d84098340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59784/0 (socket says 172.21.15.33:59784) 2024-08-15T17:54:32.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 -- 172.21.15.33:0/1058549595 learned_addr learned my addr 172.21.15.33:0/1058549595 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:32.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d8259c700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d840aab50 0x7f2d8414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:32.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 -- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d840aab50 msgr2=0x7f2d8414da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d840aab50 0x7f2d8414da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d82d9d700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d8415a8b0 0x7f2d84098880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 -- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d8415a8b0 msgr2=0x7f2d84098880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d8415a8b0 0x7f2d84098880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 -- 172.21.15.33:0/1058549595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c009420 con 0x7f2d841593b0 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d8259c700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d840aab50 0x7f2d8414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d82d9d700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d8415a8b0 0x7f2d84098880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d81d9b700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 0x7f2d84098340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00c590 tx=0x7f2d7c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c010510 con 0x7f2d841593b0 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c010690 con 0x7f2d841593b0 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d840b0010 con 0x7f2d841593b0 2024-08-15T17:54:32.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c010a50 con 0x7f2d841593b0 2024-08-15T17:54:32.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.827+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d840b05d0 con 0x7f2d841593b0 2024-08-15T17:54:32.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.831+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d840c5b50 con 0x7f2d841593b0 2024-08-15T17:54:32.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.831+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2d7c01b3b0 con 0x7f2d841593b0 2024-08-15T17:54:32.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.831+0000 7f2d7a7fc700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d64060860 0x7f2d64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:32.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.831+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2d7c07c080 con 0x7f2d841593b0 2024-08-15T17:54:32.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.831+0000 7f2d8259c700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d64060860 0x7f2d64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:32.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.831+0000 7f2d8259c700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d64060860 0x7f2d64062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c003080 tx=0x7f2d6c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:32.839+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2d840c5b50 con 0x7f2d841593b0 2024-08-15T17:54:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.019+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2d840c5b50 con 0x7f2d841593b0 2024-08-15T17:54:33.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.679+0000 7f2d7a7fc700 1 -- 172.21.15.33:0/1058549595 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2d840c5b50 con 0x7f2d841593b0 2024-08-15T17:54:33.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d64060860 msgr2=0x7f2d64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:33.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d64060860 0x7f2d64062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c003080 tx=0x7f2d6c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:33.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 msgr2=0x7f2d84098340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:33.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 0x7f2d84098340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00c590 tx=0x7f2d7c007de0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 shutdown_connections 2024-08-15T17:54:33.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d64060860 0x7f2d64062d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d8415a8b0 0x7f2d84098880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d841593b0 0x7f2d84098340 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 --2- 172.21.15.33:0/1058549595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d840aab50 0x7f2d8414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 >> 172.21.15.33:0/1058549595 conn(0x7f2d84068300 msgr2=0x7f2d840ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:33.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 shutdown_connections 2024-08-15T17:54:33.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.683+0000 7f2d88b3f700 1 -- 172.21.15.33:0/1058549595 wait complete. 2024-08-15T17:54:33.688 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-08-15T17:54:33.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-15T17:54:33.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 Processor -- start 2024-08-15T17:54:33.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 -- start start 2024-08-15T17:54:33.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f117c154900 0x7f117c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0b12d0 0x7f117c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f117c0cb390 0x7f117c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c068790 con 0x7f117c154900 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c1583f0 con 0x7f117c0cb390 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f1180f7d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0cbaa0 con 0x7f117c0b12d0 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f117b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f117c154900 0x7f117c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f117b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f117c154900 0x7f117c0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59796/0 (socket says 172.21.15.33:59796) 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f117bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f117c0cb390 0x7f117c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f117affd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0b12d0 0x7f117c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.811+0000 7f117b7fe700 1 -- 172.21.15.33:0/138510843 learned_addr learned my addr 172.21.15.33:0/138510843 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:33.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117b7fe700 1 -- 172.21.15.33:0/138510843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0b12d0 msgr2=0x7f117c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:33.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117b7fe700 1 --2- 172.21.15.33:0/138510843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0b12d0 0x7f117c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117b7fe700 1 -- 172.21.15.33:0/138510843 >> v2:172.21.15.105:3300/0 conn(0x7f117c0cb390 msgr2=0x7f117c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117b7fe700 1 --2- 172.21.15.33:0/138510843 >> v2:172.21.15.105:3300/0 conn(0x7f117c0cb390 0x7f117c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117b7fe700 1 -- 172.21.15.33:0/138510843 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0b1700 con 0x7f117c154900 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117bfff700 1 --2- 172.21.15.33:0/138510843 >> v2:172.21.15.105:3300/0 conn(0x7f117c0cb390 0x7f117c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117b7fe700 1 --2- 172.21.15.33:0/138510843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c154900 0x7f117c0b0d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f117c070340 tx=0x7f116c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9be64c8fe9eb868 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117a7fc700 1 -- 172.21.15.33:0/138510843 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00b640 con 0x7f117c154900 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117a7fc700 1 -- 172.21.15.33:0/138510843 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c00b7a0 con 0x7f117c154900 2024-08-15T17:54:33.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f117a7fc700 1 -- 172.21.15.33:0/138510843 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00bb60 con 0x7f117c154900 2024-08-15T17:54:33.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 -- 172.21.15.33:0/138510843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c154900 msgr2=0x7f117c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:33.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 --2- 172.21.15.33:0/138510843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c154900 0x7f117c0b0d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f117c070340 tx=0x7f116c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:33.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 -- 172.21.15.33:0/138510843 shutdown_connections 2024-08-15T17:54:33.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 --2- 172.21.15.33:0/138510843 >> v2:172.21.15.105:3300/0 conn(0x7f117c0cb390 0x7f117c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 --2- 172.21.15.33:0/138510843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0b12d0 0x7f117c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 --2- 172.21.15.33:0/138510843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c154900 0x7f117c0b0d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 -- 172.21.15.33:0/138510843 >> 172.21.15.33:0/138510843 conn(0x7f117c0678d0 msgr2=0x7f117c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:33.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 -- 172.21.15.33:0/138510843 shutdown_connections 2024-08-15T17:54:33.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.815+0000 7f1180f7d700 1 -- 172.21.15.33:0/138510843 wait complete. 2024-08-15T17:54:33.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 Processor -- start 2024-08-15T17:54:33.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 -- start start 2024-08-15T17:54:33.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 0x7f117c14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0cb390 0x7f117c0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f117c154900 0x7f117c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0b0ae0 con 0x7f117c0b12d0 2024-08-15T17:54:33.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c06ae30 con 0x7f117c154900 2024-08-15T17:54:33.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f1180f7d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0aa330 con 0x7f117c0cb390 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f117b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 0x7f117c14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f117b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 0x7f117c14fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59798/0 (socket says 172.21.15.33:59798) 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.819+0000 7f117b7fe700 1 -- 172.21.15.33:0/3380238378 learned_addr learned my addr 172.21.15.33:0/3380238378 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117affd700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0cb390 0x7f117c0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117bfff700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f117c154900 0x7f117c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117b7fe700 1 -- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0cb390 msgr2=0x7f117c0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117b7fe700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0cb390 0x7f117c0aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117b7fe700 1 -- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f117c154900 msgr2=0x7f117c0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117b7fe700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f117c154900 0x7f117c0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117b7fe700 1 -- 172.21.15.33:0/3380238378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174009a20 con 0x7f117c0b12d0 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f117b7fe700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 0x7f117c14fbf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f117c06c2d0 tx=0x7f116c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:33.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c000d10 con 0x7f117c0b12d0 2024-08-15T17:54:33.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c00bb20 con 0x7f117c0b12d0 2024-08-15T17:54:33.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c011630 con 0x7f117c0b12d0 2024-08-15T17:54:33.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c0094f0 con 0x7f117c0b12d0 2024-08-15T17:54:33.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c0aa8f0 con 0x7f117c0b12d0 2024-08-15T17:54:33.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c0643a0 con 0x7f117c0b12d0 2024-08-15T17:54:33.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.823+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f116c0119a0 con 0x7f117c0b12d0 2024-08-15T17:54:33.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.827+0000 7f11637fe700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1168060890 0x7f1168062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:33.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.827+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f116c07d9c0 con 0x7f117c0b12d0 2024-08-15T17:54:33.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.827+0000 7f117affd700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1168060890 0x7f1168062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:33.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.827+0000 7f117affd700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1168060890 0x7f1168062d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f117c151df0 tx=0x7f11700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:33.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:33.835+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f116c04e350 con 0x7f117c0b12d0 2024-08-15T17:54:34.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.059+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f117c06f5f0 con 0x7f117c0b12d0 2024-08-15T17:54:34.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.059+0000 7f11637fe700 1 -- 172.21.15.33:0/3380238378 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f116c051970 con 0x7f117c0b12d0 2024-08-15T17:54:34.061 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:34.061 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:54:34.061 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-08-15T17:54:34.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.061 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB1QL5mvPjBNBAAieKNgU96svHx7vPDq1EMQw==", 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.062 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB2QL5moIm+AhAATG191CEUklyNvb8cqiumww==", 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB1QL5mWSffNxAA8/rQfoO6UBnxjTWVgWBxUg==", 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB2QL5mqBXNBRAAUKpQtLwbCiwZEWWxFqVw6w==", 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.065 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB4QL5mtVfTNBAAIc22r352BIfcol7MxhVBEg==", 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB7QL5mfkDIORAAMHUms+6UWHmNqPQNLAy5jg==", 2024-08-15T17:54:34.066 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/QL5mXKo9ABAAw+SU33tDtqQPfT9nBxt4xQ==", 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.067 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCCQL5m/7C0AxAAgOWZmo2kuXSUk/BshfJ6QA==", 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.068 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCHQL5m/5XjJRAAMid90orphPuehQIJ3xQrmQ==", 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.069 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCKQL5m0ZZuKRAAyqhqZJTdSEOY30hH0OJPHg==", 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.070 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCNQL5mKctBLRAATaclaljbaSlpG35oMGYV0g==", 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCQQL5mZay1MRAA6wpGClDVLvO0M9c/gh6pzQ==", 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB2QL5mUeDPCBAAoqRC25zbBCSHX+87Ir5SMA==", 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.073 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-08-15T17:54:34.074 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB2QL5mUYH9DhAAQoUsKQup94K3zQgpVcIoCg==", 2024-08-15T17:54:34.074 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.074 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.074 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-08-15T17:54:34.074 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB2QL5mhb9wCxAAKZxUyvhhC5dXanUG9msgog==", 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-08-15T17:54:34.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB2QL5msz17ERAATWZSxBfTJBkxx0TqhQrfTQ==", 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB1QL5motaYJBAAVzV5MepnawiQNUDLNkrhow==", 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mds", 2024-08-15T17:54:34.077 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVQL5mbZkbNhAAgR1pmq2OwAJqaNFAw2IBpg==", 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mds" 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mgr", 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVQL5mlqwbNhAAQZoMEq7efEU5d0feOQYg9w==", 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-osd", 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVQL5mRsAbNhAA1/YTU1hSGKK8tUk3WA/vcg==", 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-osd" 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd", 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVQL5mc9EbNhAAfF4cP//fhRwblsfSqwqGeg==", 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVQL5m1eUbNhAAYxdwSx3qkfQ5t16qA/OJDg==", 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rgw", 2024-08-15T17:54:34.080 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVQL5m3/gbNhAARb7IEp6CFm58QC4VSbr7Dg==", 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB1QL5m75KyMRAAizhpI7ACW6VlyhTvL9uLhw==", 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-08-15T17:54:34.081 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB1QL5myei8LhAAur9jSJJeEx2EV6MHh0ILiQ==", 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.082 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:34.083 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-15T17:54:34.083 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:54:34.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1168060890 msgr2=0x7f1168062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1168060890 0x7f1168062d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f117c151df0 tx=0x7f11700091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 msgr2=0x7f117c14fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 0x7f117c14fbf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f117c06c2d0 tx=0x7f116c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 shutdown_connections 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1168060890 0x7f1168062d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f117c154900 0x7f117c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f117c0cb390 0x7f117c0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 --2- 172.21.15.33:0/3380238378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117c0b12d0 0x7f117c14fbf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 >> 172.21.15.33:0/3380238378 conn(0x7f117c0678d0 msgr2=0x7f117c1522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 shutdown_connections 2024-08-15T17:54:34.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.063+0000 7f1180f7d700 1 -- 172.21.15.33:0/3380238378 wait complete. 2024-08-15T17:54:34.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-15T17:54:34.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 Processor -- start 2024-08-15T17:54:34.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 -- start start 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f93e0159040 0x7f93e00cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00cf190 con 0x7f93e015cea0 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00d09a0 con 0x7f93e0159040 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93e4a6c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00ce5e0 con 0x7f93e00d0010 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f93e0159040 0x7f93e00cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93dffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f93e015cea0 0x7f93e015d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60692/0 (socket says 172.21.15.33:60692) 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93dffff700 1 -- 172.21.15.33:0/3451319650 learned_addr learned my addr 172.21.15.33:0/3451319650 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 --2- 172.21.15.33:0/3451319650 >> v2:172.21.15.33:3300/0 conn(0x7f93e0159040 0x7f93e00cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59804/0 (socket says 172.21.15.33:59804) 2024-08-15T17:54:34.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93deffd700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93de7fc700 1 -- 172.21.15.33:0/3451319650 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312949554 0 0) 0x7f93e00cf190 con 0x7f93e015cea0 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93de7fc700 1 -- 172.21.15.33:0/3451319650 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c0003570 con 0x7f93e015cea0 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 -- 172.21.15.33:0/3451319650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 msgr2=0x7f93e00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 -- 172.21.15.33:0/3451319650 >> v1:172.21.15.33:6789/0 conn(0x7f93e015cea0 legacy=0x7f93e015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 -- 172.21.15.33:0/3451319650 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00ce860 con 0x7f93e0159040 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93deffd700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93df7fe700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cf620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009e60 tx=0x7f93d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4def43a5f7055b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93de7fc700 1 -- 172.21.15.33:0/3451319650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000e070 con 0x7f93e0159040 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93de7fc700 1 -- 172.21.15.33:0/3451319650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000bb60 con 0x7f93e0159040 2024-08-15T17:54:34.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.199+0000 7f93de7fc700 1 -- 172.21.15.33:0/3451319650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0012430 con 0x7f93e0159040 2024-08-15T17:54:34.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 -- 172.21.15.33:0/3451319650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 msgr2=0x7f93e00cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cf620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009e60 tx=0x7f93d0009780 comp rx=0 tx=0).stop 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 -- 172.21.15.33:0/3451319650 shutdown_connections 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/3451319650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cf620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 -- 172.21.15.33:0/3451319650 >> 172.21.15.33:0/3451319650 conn(0x7f93e0068250 msgr2=0x7f93e0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 -- 172.21.15.33:0/3451319650 shutdown_connections 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 -- 172.21.15.33:0/3451319650 wait complete. 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 Processor -- start 2024-08-15T17:54:34.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.203+0000 7f93e4a6c700 1 -- start start 2024-08-15T17:54:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93e015cea0 0x7f93e00b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00ccb10 con 0x7f93e0159040 2024-08-15T17:54:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00b0db0 con 0x7f93e015cea0 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00b1930 con 0x7f93e00d0010 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59810/0 (socket says 172.21.15.33:59810) 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 -- 172.21.15.33:0/2932015743 learned_addr learned my addr 172.21.15.33:0/2932015743 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93dffff700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93e015cea0 0x7f93e00b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 -- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 msgr2=0x7f93e00c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93df7fe700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 -- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93e015cea0 msgr2=0x7f93e00b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93e015cea0 0x7f93e00b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 -- 172.21.15.33:0/2932015743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009a20 con 0x7f93e0159040 2024-08-15T17:54:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93df7fe700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93deffd700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cc5d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d860 tx=0x7f93c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80125f0 con 0x7f93e0159040 2024-08-15T17:54:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8012750 con 0x7f93e0159040 2024-08-15T17:54:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e00b1000 con 0x7f93e0159040 2024-08-15T17:54:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8012af0 con 0x7f93e0159040 2024-08-15T17:54:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e00b15c0 con 0x7f93e0159040 2024-08-15T17:54:34.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e00b1ae0 con 0x7f93e0159040 2024-08-15T17:54:34.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f93c8014430 con 0x7f93e0159040 2024-08-15T17:54:34.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.207+0000 7f93d77fe700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f93c4060890 0x7f93c4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.211+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f93c807cc30 con 0x7f93e0159040 2024-08-15T17:54:34.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.211+0000 7f93df7fe700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f93c4060890 0x7f93c4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.211+0000 7f93df7fe700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f93c4060890 0x7f93c4062d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93d0003400 tx=0x7f93d0019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.219+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f93e00b1ae0 con 0x7f93e0159040 2024-08-15T17:54:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.439+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f93e00b1aa0 con 0x7f93e0159040 2024-08-15T17:54:34.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.443+0000 7f93d77fe700 1 -- 172.21.15.33:0/2932015743 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f93c804d3d0 con 0x7f93e0159040 2024-08-15T17:54:34.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f93c4060890 msgr2=0x7f93c4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f93c4060890 0x7f93c4062d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93d0003400 tx=0x7f93d0019000 comp rx=0 tx=0).stop 2024-08-15T17:54:34.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 msgr2=0x7f93e00cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cc5d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d860 tx=0x7f93c8008040 comp rx=0 tx=0).stop 2024-08-15T17:54:34.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 shutdown_connections 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f93c4060890 0x7f93c4062d40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93e015cea0 0x7f93e00b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e0159040 0x7f93e00cc5d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 --2- 172.21.15.33:0/2932015743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93e00d0010 0x7f93e00c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 >> 172.21.15.33:0/2932015743 conn(0x7f93e0068250 msgr2=0x7f93e0159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 shutdown_connections 2024-08-15T17:54:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.447+0000 7f93e4a6c700 1 -- 172.21.15.33:0/2932015743 wait complete. 2024-08-15T17:54:34.460 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-15T17:54:34.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 Processor -- start 2024-08-15T17:54:34.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 -- start start 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd654154b40 0x7fd6540af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd65415acf0 0x7fd65415b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540ca200 con 0x7fd6540aee60 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540cbbf0 con 0x7fd654154b40 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.567+0000 7fd65b112700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540c98d0 con 0x7fd65415acf0 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd654154b40 0x7fd6540af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd654154b40 0x7fd6540af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59822/0 (socket says 172.21.15.33:59822) 2024-08-15T17:54:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 -- 172.21.15.33:0/3410700647 learned_addr learned my addr 172.21.15.33:0/3410700647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:34.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65a911700 1 --2- 172.21.15.33:0/3410700647 >> v2:172.21.15.105:3300/0 conn(0x7fd65415acf0 0x7fd65415b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 -- 172.21.15.33:0/3410700647 >> v2:172.21.15.105:3300/0 conn(0x7fd65415acf0 msgr2=0x7fd65415b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 --2- 172.21.15.33:0/3410700647 >> v2:172.21.15.105:3300/0 conn(0x7fd65415acf0 0x7fd65415b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 -- 172.21.15.33:0/3410700647 >> v1:172.21.15.105:6789/0 conn(0x7fd6540aee60 legacy=0x7fd654154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 -- 172.21.15.33:0/3410700647 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540c9bb0 con 0x7fd654154b40 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65a911700 1 --2- 172.21.15.33:0/3410700647 >> v2:172.21.15.105:3300/0 conn(0x7fd65415acf0 0x7fd65415b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65990f700 1 --2- 172.21.15.33:0/3410700647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd654154b40 0x7fd6540af230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6540ca170 tx=0x7fd650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f39cbb519f42b3e server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65910e700 1 -- 172.21.15.33:0/3410700647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000e070 con 0x7fd654154b40 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65910e700 1 -- 172.21.15.33:0/3410700647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65000ba20 con 0x7fd654154b40 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65910e700 1 -- 172.21.15.33:0/3410700647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500092e0 con 0x7fd654154b40 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 -- 172.21.15.33:0/3410700647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd654154b40 msgr2=0x7fd6540af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 --2- 172.21.15.33:0/3410700647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd654154b40 0x7fd6540af230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6540ca170 tx=0x7fd650009840 comp rx=0 tx=0).stop 2024-08-15T17:54:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 -- 172.21.15.33:0/3410700647 shutdown_connections 2024-08-15T17:54:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 --2- 172.21.15.33:0/3410700647 >> v2:172.21.15.105:3300/0 conn(0x7fd65415acf0 0x7fd65415b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 --2- 172.21.15.33:0/3410700647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd654154b40 0x7fd6540af230 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 -- 172.21.15.33:0/3410700647 >> 172.21.15.33:0/3410700647 conn(0x7fd65406e100 msgr2=0x7fd6540b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 -- 172.21.15.33:0/3410700647 shutdown_connections 2024-08-15T17:54:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.571+0000 7fd65b112700 1 -- 172.21.15.33:0/3410700647 wait complete. 2024-08-15T17:54:34.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 Processor -- start 2024-08-15T17:54:34.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 -- start start 2024-08-15T17:54:34.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 0x7fd654152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd654154b40 0x7fd654167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd65415acf0 0x7fd6540abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ab940 con 0x7fd6540aee60 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654152eb0 con 0x7fd654154b40 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65b112700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654168300 con 0x7fd65415acf0 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 0x7fd654152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 0x7fd654152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59828/0 (socket says 172.21.15.33:59828) 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 -- 172.21.15.33:0/2046902947 learned_addr learned my addr 172.21.15.33:0/2046902947 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65990f700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd654154b40 0x7fd654167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a911700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd65415acf0 0x7fd6540abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 -- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd65415acf0 msgr2=0x7fd6540abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd65415acf0 0x7fd6540abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 -- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd654154b40 msgr2=0x7fd654167dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd654154b40 0x7fd654167dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.575+0000 7fd65a110700 1 -- 172.21.15.33:0/2046902947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c009420 con 0x7fd6540aee60 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd65990f700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd654154b40 0x7fd654167dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd65a110700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 0x7fd654152970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd64400c590 tx=0x7fd64400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644011590 con 0x7fd6540aee60 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644011710 con 0x7fd6540aee60 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd650009ae0 con 0x7fd6540aee60 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644011ad0 con 0x7fd6540aee60 2024-08-15T17:54:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6540ab010 con 0x7fd6540aee60 2024-08-15T17:54:34.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6540638f0 con 0x7fd6540aee60 2024-08-15T17:54:34.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.579+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd64401b3b0 con 0x7fd6540aee60 2024-08-15T17:54:34.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.583+0000 7fd64a7fc700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd640060860 0x7fd640062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.583+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd64407bd10 con 0x7fd6540aee60 2024-08-15T17:54:34.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.583+0000 7fd65990f700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd640060860 0x7fd640062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.583+0000 7fd65990f700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd640060860 0x7fd640062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd650009880 tx=0x7fd650018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.591+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd64404c550 con 0x7fd6540aee60 2024-08-15T17:54:34.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.815+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd6540ccb70 con 0x7fd6540aee60 2024-08-15T17:54:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd64a7fc700 1 -- 172.21.15.33:0/2046902947 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd644017020 con 0x7fd6540aee60 2024-08-15T17:54:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd640060860 msgr2=0x7fd640062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd640060860 0x7fd640062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd650009880 tx=0x7fd650018000 comp rx=0 tx=0).stop 2024-08-15T17:54:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 msgr2=0x7fd654152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 0x7fd654152970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd64400c590 tx=0x7fd64400c8a0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 shutdown_connections 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd640060860 0x7fd640062d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd654154b40 0x7fd654167dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd65415acf0 0x7fd6540abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 --2- 172.21.15.33:0/2046902947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540aee60 0x7fd654152970 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 >> 172.21.15.33:0/2046902947 conn(0x7fd65406e100 msgr2=0x7fd654067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 shutdown_connections 2024-08-15T17:54:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.827+0000 7fd65b112700 1 -- 172.21.15.33:0/2046902947 wait complete. 2024-08-15T17:54:34.844 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-15T17:54:34.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e9dada700 1 Processor -- start 2024-08-15T17:54:34.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e9dada700 1 -- start start 2024-08-15T17:54:34.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e9dada700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1e980ac330 0x7f1e980cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e9dada700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9815bab0 con 0x7f1e980b1690 2024-08-15T17:54:34.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e9dada700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980afec0 con 0x7f1e980ac700 2024-08-15T17:54:34.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e9dada700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e980ad2a0 con 0x7f1e980ac330 2024-08-15T17:54:34.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e97fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1e980b1690 0x7f1e9815b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60698/0 (socket says 172.21.15.33:60698) 2024-08-15T17:54:34.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e97fff700 1 -- 172.21.15.33:0/1326054975 learned_addr learned my addr 172.21.15.33:0/1326054975 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:34.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e977fe700 1 --2- 172.21.15.33:0/1326054975 >> v2:172.21.15.105:3300/0 conn(0x7f1e980ac330 0x7f1e980cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919540666 0 0) 0x7f1e980afec0 con 0x7f1e980ac700 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e84003570 con 0x7f1e980ac700 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.951+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179846476 0 0) 0x7f1e9815bab0 con 0x7f1e980b1690 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e980afec0 con 0x7f1e980b1690 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574438512 0 0) 0x7f1e84003570 con 0x7f1e980ac700 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e977fe700 1 -- 172.21.15.33:0/1326054975 >> v1:172.21.15.105:6789/0 conn(0x7f1e980ac700 legacy=0x7f1e9815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e977fe700 1 -- 172.21.15.33:0/1326054975 >> v1:172.21.15.33:6789/0 conn(0x7f1e980b1690 legacy=0x7f1e9815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e977fe700 1 -- 172.21.15.33:0/1326054975 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980ad560 con 0x7f1e980ac330 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e977fe700 1 --2- 172.21.15.33:0/1326054975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac330 0x7f1e980cbb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009860 tx=0x7f1e880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db0f0759831e5d8f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80001470 con 0x7f1e980ac330 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88011420 con 0x7f1e980ac330 2024-08-15T17:54:34.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e96ffd700 1 -- 172.21.15.33:0/1326054975 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880117a0 con 0x7f1e980ac330 2024-08-15T17:54:34.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 -- 172.21.15.33:0/1326054975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac330 msgr2=0x7f1e980cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 --2- 172.21.15.33:0/1326054975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac330 0x7f1e980cbb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009860 tx=0x7f1e880091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 -- 172.21.15.33:0/1326054975 shutdown_connections 2024-08-15T17:54:34.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 --2- 172.21.15.33:0/1326054975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac330 0x7f1e980cbb80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 -- 172.21.15.33:0/1326054975 >> 172.21.15.33:0/1326054975 conn(0x7f1e9806e210 msgr2=0x7f1e9806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:34.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 -- 172.21.15.33:0/1326054975 shutdown_connections 2024-08-15T17:54:34.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 -- 172.21.15.33:0/1326054975 wait complete. 2024-08-15T17:54:34.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 Processor -- start 2024-08-15T17:54:34.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.955+0000 7f1e9dada700 1 -- start start 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 0x7f1e980969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac700 0x7f1e980678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e980b1690 0x7f1e9806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9806b210 con 0x7f1e980ac330 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98099180 con 0x7f1e980ac700 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98099a20 con 0x7f1e980b1690 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 0x7f1e980969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 0x7f1e980969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59830/0 (socket says 172.21.15.33:59830) 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 -- 172.21.15.33:0/2409457525 learned_addr learned my addr 172.21.15.33:0/2409457525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e97fff700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e980b1690 0x7f1e9806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e8effd700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac700 0x7f1e980678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 -- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e980b1690 msgr2=0x7f1e9806acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e980b1690 0x7f1e9806acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 -- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac700 msgr2=0x7f1e980678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:34.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac700 0x7f1e980678b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:34.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 -- 172.21.15.33:0/2409457525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009420 con 0x7f1e980ac330 2024-08-15T17:54:34.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e8effd700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac700 0x7f1e980678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:34.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e977fe700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 0x7f1e980969f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1e880093f0 tx=0x7f1e88016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8801cc90 con 0x7f1e980ac330 2024-08-15T17:54:34.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8801ce10 con 0x7f1e980ac330 2024-08-15T17:54:34.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9806b430 con 0x7f1e980ac330 2024-08-15T17:54:34.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8801a6a0 con 0x7f1e980ac330 2024-08-15T17:54:34.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e980996b0 con 0x7f1e980ac330 2024-08-15T17:54:34.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1e8801aa50 con 0x7f1e980ac330 2024-08-15T17:54:34.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.959+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e980645c0 con 0x7f1e980ac330 2024-08-15T17:54:34.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.963+0000 7f1e8ffff700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1e78060860 0x7f1e78062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:34.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.963+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1e8807e2b0 con 0x7f1e980ac330 2024-08-15T17:54:34.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.963+0000 7f1e8effd700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1e78060860 0x7f1e78062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:34.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.963+0000 7f1e8effd700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1e78060860 0x7f1e78062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e9816af20 tx=0x7f1e800014a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:34.967+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1e8804ea50 con 0x7f1e980ac330 2024-08-15T17:54:35.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.187+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1e980af7d0 con 0x7f1e980ac330 2024-08-15T17:54:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.191+0000 7f1e8ffff700 1 -- 172.21.15.33:0/2409457525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1e88052070 con 0x7f1e980ac330 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1e78060860 msgr2=0x7f1e78062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1e78060860 0x7f1e78062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e9816af20 tx=0x7f1e800014a0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 msgr2=0x7f1e980969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 0x7f1e980969f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1e880093f0 tx=0x7f1e88016000 comp rx=0 tx=0).stop 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 shutdown_connections 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1e78060860 0x7f1e78062d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e980ac700 0x7f1e980678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e980b1690 0x7f1e9806acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 --2- 172.21.15.33:0/2409457525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e980ac330 0x7f1e980969f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 >> 172.21.15.33:0/2409457525 conn(0x7f1e9806e210 msgr2=0x7f1e980c1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 shutdown_connections 2024-08-15T17:54:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.195+0000 7f1e9dada700 1 -- 172.21.15.33:0/2409457525 wait complete. 2024-08-15T17:54:35.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-15T17:54:35.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 Processor -- start 2024-08-15T17:54:35.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 -- start start 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f30140950 0x7f2f300ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f300ae800 0x7f2f300c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f300b0da0 con 0x7f2f300c95e0 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f300aec30 con 0x7f2f300ae800 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f36359700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300c9dd0 con 0x7f2f30140950 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f35b58700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2f300c95e0 0x7f2f300cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60700/0 (socket says 172.21.15.33:60700) 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f35b58700 1 -- 172.21.15.33:0/1589681816 learned_addr learned my addr 172.21.15.33:0/1589681816 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f34b56700 1 --2- 172.21.15.33:0/1589681816 >> v2:172.21.15.105:3300/0 conn(0x7f2f300ae800 0x7f2f300c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f35357700 1 --2- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f30140950 0x7f2f300ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f27fff700 1 -- 172.21.15.33:0/1589681816 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117744461 0 0) 0x7f2f300b0da0 con 0x7f2f300c95e0 2024-08-15T17:54:35.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.315+0000 7f2f27fff700 1 -- 172.21.15.33:0/1589681816 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f1c003570 con 0x7f2f300c95e0 2024-08-15T17:54:35.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f27fff700 1 -- 172.21.15.33:0/1589681816 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976258717 0 0) 0x7f2f1c003570 con 0x7f2f300c95e0 2024-08-15T17:54:35.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f34b56700 1 -- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f30140950 msgr2=0x7f2f300ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:35.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f34b56700 1 --2- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f30140950 0x7f2f300ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f34b56700 1 -- 172.21.15.33:0/1589681816 >> v1:172.21.15.33:6789/0 conn(0x7f2f300c95e0 legacy=0x7f2f300cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f34b56700 1 -- 172.21.15.33:0/1589681816 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300ca0b0 con 0x7f2f300ae800 2024-08-15T17:54:35.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f34b56700 1 --2- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f300ae800 0x7f2f300c90a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0098e0 tx=0x7f2f2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69370fb096f38eb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f27fff700 1 -- 172.21.15.33:0/1589681816 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280017f0 con 0x7f2f300ae800 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f27fff700 1 -- 172.21.15.33:0/1589681816 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c011420 con 0x7f2f300ae800 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f27fff700 1 -- 172.21.15.33:0/1589681816 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0117a0 con 0x7f2f300ae800 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 -- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f300ae800 msgr2=0x7f2f300c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 --2- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f300ae800 0x7f2f300c90a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0098e0 tx=0x7f2f2c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 -- 172.21.15.33:0/1589681816 shutdown_connections 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 --2- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f300ae800 0x7f2f300c90a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 --2- 172.21.15.33:0/1589681816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f30140950 0x7f2f300ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 -- 172.21.15.33:0/1589681816 >> 172.21.15.33:0/1589681816 conn(0x7f2f300ca900 msgr2=0x7f2f300cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 -- 172.21.15.33:0/1589681816 shutdown_connections 2024-08-15T17:54:35.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 -- 172.21.15.33:0/1589681816 wait complete. 2024-08-15T17:54:35.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 Processor -- start 2024-08-15T17:54:35.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.319+0000 7f2f36359700 1 -- start start 2024-08-15T17:54:35.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 0x7f2f301566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f300c95e0 0x7f2f301398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f30140950 0x7f2f3013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300c6020 con 0x7f2f300ae800 2024-08-15T17:54:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3013ae10 con 0x7f2f30140950 2024-08-15T17:54:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300c5410 con 0x7f2f300c95e0 2024-08-15T17:54:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 0x7f2f301566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 0x7f2f301566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59838/0 (socket says 172.21.15.33:59838) 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 -- 172.21.15.33:0/2181712368 learned_addr learned my addr 172.21.15.33:0/2181712368 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35b58700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f30140950 0x7f2f3013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f34b56700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f300c95e0 0x7f2f301398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 -- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f300c95e0 msgr2=0x7f2f301398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f300c95e0 0x7f2f301398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 -- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f30140950 msgr2=0x7f2f3013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f30140950 0x7f2f3013a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 -- 172.21.15.33:0/2181712368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c009420 con 0x7f2f300ae800 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f35357700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 0x7f2f301566a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000ec80 tx=0x7f2f200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000c850 con 0x7f2f300ae800 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2000c9b0 con 0x7f2f300ae800 2024-08-15T17:54:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f300c56f0 con 0x7f2f300ae800 2024-08-15T17:54:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000cd50 con 0x7f2f300ae800 2024-08-15T17:54:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f300c5cb0 con 0x7f2f300ae800 2024-08-15T17:54:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.323+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f300643a0 con 0x7f2f300ae800 2024-08-15T17:54:35.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.327+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2f20013680 con 0x7f2f300ae800 2024-08-15T17:54:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.327+0000 7f2f257fa700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2f14060860 0x7f2f14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.327+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f2007caf0 con 0x7f2f300ae800 2024-08-15T17:54:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.327+0000 7f2f34b56700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2f14060860 0x7f2f14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.327+0000 7f2f34b56700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2f14060860 0x7f2f14062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0091e0 tx=0x7f2f2c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:35.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.335+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2f2004d290 con 0x7f2f300ae800 2024-08-15T17:54:35.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.551+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2f30156c60 con 0x7f2f300ae800 2024-08-15T17:54:35.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.559+0000 7f2f257fa700 1 -- 172.21.15.33:0/2181712368 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2f200508b0 con 0x7f2f300ae800 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2f14060860 msgr2=0x7f2f14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2f14060860 0x7f2f14062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0091e0 tx=0x7f2f2c016000 comp rx=0 tx=0).stop 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 msgr2=0x7f2f301566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 0x7f2f301566a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000ec80 tx=0x7f2f200091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 shutdown_connections 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2f14060860 0x7f2f14062d10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f30140950 0x7f2f3013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f300c95e0 0x7f2f301398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 --2- 172.21.15.33:0/2181712368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f300ae800 0x7f2f301566a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 >> 172.21.15.33:0/2181712368 conn(0x7f2f300ca900 msgr2=0x7f2f300b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 shutdown_connections 2024-08-15T17:54:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.563+0000 7f2f36359700 1 -- 172.21.15.33:0/2181712368 wait complete. 2024-08-15T17:54:35.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-15T17:54:35.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 Processor -- start 2024-08-15T17:54:35.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 -- start start 2024-08-15T17:54:35.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e1e10 0x7f925c005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f925c0e2610 0x7f925c03af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0e2b40 con 0x7f925c0e21e0 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c055930 con 0x7f925c0e2610 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a807700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0e2e20 con 0x7f925c0e1e10 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f925c0e2610 0x7f925c03af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f925c0e2610 0x7f925c03af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59850/0 (socket says 172.21.15.33:59850) 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 -- 172.21.15.33:0/1388530593 learned_addr learned my addr 172.21.15.33:0/1388530593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f9269805700 1 --2- 172.21.15.33:0/1388530593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e1e10 0x7f925c005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 -- 172.21.15.33:0/1388530593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e1e10 msgr2=0x7f925c005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 --2- 172.21.15.33:0/1388530593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e1e10 0x7f925c005eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 -- 172.21.15.33:0/1388530593 >> v1:172.21.15.33:6789/0 conn(0x7f925c0e21e0 legacy=0x7f925c0392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 -- 172.21.15.33:0/1388530593 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0e3100 con 0x7f925c0e2610 2024-08-15T17:54:35.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f926a006700 1 --2- 172.21.15.33:0/1388530593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03af40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9264060860 tx=0x7f9264064ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f40c217ec0b271e server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f9268803700 1 -- 172.21.15.33:0/1388530593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926402b0f0 con 0x7f925c0e2610 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f9268803700 1 -- 172.21.15.33:0/1388530593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926404c190 con 0x7f925c0e2610 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.687+0000 7f9268803700 1 -- 172.21.15.33:0/1388530593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264070080 con 0x7f925c0e2610 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- 172.21.15.33:0/1388530593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 msgr2=0x7f925c03af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 --2- 172.21.15.33:0/1388530593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03af40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9264060860 tx=0x7f9264064ee0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- 172.21.15.33:0/1388530593 shutdown_connections 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 --2- 172.21.15.33:0/1388530593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03af40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 --2- 172.21.15.33:0/1388530593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e1e10 0x7f925c005eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- 172.21.15.33:0/1388530593 >> 172.21.15.33:0/1388530593 conn(0x7f925c059af0 msgr2=0x7f925c055a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- 172.21.15.33:0/1388530593 shutdown_connections 2024-08-15T17:54:35.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- 172.21.15.33:0/1388530593 wait complete. 2024-08-15T17:54:35.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 Processor -- start 2024-08-15T17:54:35.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- start start 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f925c0e1e10 0x7f925c0f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e21e0 0x7f925c0529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c04d710 con 0x7f925c0e2610 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c04d9f0 con 0x7f925c0e1e10 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a807700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c04dcd0 con 0x7f925c0e21e0 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59864/0 (socket says 172.21.15.33:59864) 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 -- 172.21.15.33:0/1219327518 learned_addr learned my addr 172.21.15.33:0/1219327518 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f9269805700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f925c0e1e10 0x7f925c0f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f9269004700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e21e0 0x7f925c0529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 -- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e21e0 msgr2=0x7f925c0529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e21e0 0x7f925c0529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 -- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f925c0e1e10 msgr2=0x7f925c0f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f925c0e1e10 0x7f925c0f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 -- 172.21.15.33:0/1219327518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c04dfb0 con 0x7f925c0e2610 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f9269805700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f925c0e1e10 0x7f925c0f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f9269004700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e21e0 0x7f925c0529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f926a006700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03e120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9264076ee0 tx=0x7f926406f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264070bc0 con 0x7f925c0e2610 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c04e290 con 0x7f925c0e2610 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.691+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926406d070 con 0x7f925c0e2610 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264070f30 con 0x7f925c0e2610 2024-08-15T17:54:35.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c0f2be0 con 0x7f925c0e2610 2024-08-15T17:54:35.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c0053b0 con 0x7f925c0e2610 2024-08-15T17:54:35.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f92640698f0 con 0x7f925c0e2610 2024-08-15T17:54:35.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f9259ffb700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9248060860 0x7f9248062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:35.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f92640f4fb0 con 0x7f925c0e2610 2024-08-15T17:54:35.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f9269805700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9248060860 0x7f9248062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:35.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.695+0000 7f9269805700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9248060860 0x7f9248062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9254006fd0 tx=0x7f9254008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:35.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.703+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f92640c57b0 con 0x7f925c0e2610 2024-08-15T17:54:35.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.927+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f925c04f940 con 0x7f925c0e2610 2024-08-15T17:54:35.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.931+0000 7f9259ffb700 1 -- 172.21.15.33:0/1219327518 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f92640c8dd0 con 0x7f925c0e2610 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9248060860 msgr2=0x7f9248062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9248060860 0x7f9248062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9254006fd0 tx=0x7f9254008040 comp rx=0 tx=0).stop 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 msgr2=0x7f925c03e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03e120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9264076ee0 tx=0x7f926406f000 comp rx=0 tx=0).stop 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 shutdown_connections 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9248060860 0x7f9248062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f925c0e2610 0x7f925c03e120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f925c0e21e0 0x7f925c0529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 --2- 172.21.15.33:0/1219327518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f925c0e1e10 0x7f925c0f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 >> 172.21.15.33:0/1219327518 conn(0x7f925c059af0 msgr2=0x7f925c0e4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 shutdown_connections 2024-08-15T17:54:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:35.935+0000 7f926a807700 1 -- 172.21.15.33:0/1219327518 wait complete. 2024-08-15T17:54:35.950 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-15T17:54:36.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 Processor -- start 2024-08-15T17:54:36.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 -- start start 2024-08-15T17:54:36.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a415a620 0x7f61a40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61a40b0f10 0x7f61a40adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a40ae530 con 0x7f61a40ae0d0 2024-08-15T17:54:36.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a40aff10 con 0x7f61a40b0f10 2024-08-15T17:54:36.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61aa0bd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40a9160 con 0x7f61a415a620 2024-08-15T17:54:36.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61a40b0f10 0x7f61a40adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61a40b0f10 0x7f61a40adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59876/0 (socket says 172.21.15.33:59876) 2024-08-15T17:54:36.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 -- 172.21.15.33:0/857823962 learned_addr learned my addr 172.21.15.33:0/857823962 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:36.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a37fe700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a415a620 0x7f61a40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 -- 172.21.15.33:0/857823962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a415a620 msgr2=0x7f61a40ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:36.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a415a620 0x7f61a40ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 -- 172.21.15.33:0/857823962 >> v1:172.21.15.105:6789/0 conn(0x7f61a40ae0d0 legacy=0x7f61a406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 -- 172.21.15.33:0/857823962 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40b1680 con 0x7f61a40b0f10 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a37fe700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a415a620 0x7f61a40ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.063+0000 7f61a2ffd700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a40adb90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6194009f20 tx=0x7f6194009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54483cf154461ac server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61a27fc700 1 -- 172.21.15.33:0/857823962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400e070 con 0x7f61a40b0f10 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61a27fc700 1 -- 172.21.15.33:0/857823962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619400ba80 con 0x7f61a40b0f10 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61a27fc700 1 -- 172.21.15.33:0/857823962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61940092e0 con 0x7f61a40b0f10 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 -- 172.21.15.33:0/857823962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 msgr2=0x7f61a40adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a40adb90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6194009f20 tx=0x7f6194009840 comp rx=0 tx=0).stop 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 -- 172.21.15.33:0/857823962 shutdown_connections 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a40adb90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/857823962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a415a620 0x7f61a40ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 -- 172.21.15.33:0/857823962 >> 172.21.15.33:0/857823962 conn(0x7f61a4067810 msgr2=0x7f61a4067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 -- 172.21.15.33:0/857823962 shutdown_connections 2024-08-15T17:54:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 -- 172.21.15.33:0/857823962 wait complete. 2024-08-15T17:54:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 Processor -- start 2024-08-15T17:54:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.067+0000 7f61aa0bd700 1 -- start start 2024-08-15T17:54:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a40ae0d0 0x7f61a4167680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61a415a620 0x7f61a40c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41551f0 con 0x7f61a40b0f10 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4167cd0 con 0x7f61a415a620 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4167fb0 con 0x7f61a40ae0d0 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a4154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59892/0 (socket says 172.21.15.33:59892) 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 -- 172.21.15.33:0/1894019164 learned_addr learned my addr 172.21.15.33:0/1894019164 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a3fff700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61a415a620 0x7f61a40c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a37fe700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a40ae0d0 0x7f61a4167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 -- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a40ae0d0 msgr2=0x7f61a4167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a40ae0d0 0x7f61a4167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 -- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61a415a620 msgr2=0x7f61a40c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61a415a620 0x7f61a40c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 -- 172.21.15.33:0/1894019164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194009ae0 con 0x7f61a40b0f10 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a3fff700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61a415a620 0x7f61a40c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61a2ffd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a4154cb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f619400b6c0 tx=0x7f6194018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194008980 con 0x7f61a40b0f10 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a4168290 con 0x7f61a40b0f10 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6194008ae0 con 0x7f61a40b0f10 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a40c9500 con 0x7f61a40b0f10 2024-08-15T17:54:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.071+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194008ea0 con 0x7f61a40b0f10 2024-08-15T17:54:36.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.075+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a40c9350 con 0x7f61a40b0f10 2024-08-15T17:54:36.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.075+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6194003040 con 0x7f61a40b0f10 2024-08-15T17:54:36.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.075+0000 7f618b7fe700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6190060860 0x7f6190062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.075+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f619407dcc0 con 0x7f61a40b0f10 2024-08-15T17:54:36.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.075+0000 7f61a37fe700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6190060860 0x7f6190062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.075+0000 7f61a37fe700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6190060860 0x7f6190062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6198006f00 tx=0x7f6198008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.083+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6194084080 con 0x7f61a40b0f10 2024-08-15T17:54:36.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.307+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f61a40c9720 con 0x7f61a40b0f10 2024-08-15T17:54:36.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f618b7fe700 1 -- 172.21.15.33:0/1894019164 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f61940200a0 con 0x7f61a40b0f10 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6190060860 msgr2=0x7f6190062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6190060860 0x7f6190062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6198006f00 tx=0x7f6198008040 comp rx=0 tx=0).stop 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 msgr2=0x7f61a4154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a4154cb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f619400b6c0 tx=0x7f6194018000 comp rx=0 tx=0).stop 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 shutdown_connections 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6190060860 0x7f6190062d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61a415a620 0x7f61a40c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61a40b0f10 0x7f61a4154cb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 --2- 172.21.15.33:0/1894019164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61a40ae0d0 0x7f61a4167680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 >> 172.21.15.33:0/1894019164 conn(0x7f61a4067810 msgr2=0x7f61a406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 shutdown_connections 2024-08-15T17:54:36.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.315+0000 7f61aa0bd700 1 -- 172.21.15.33:0/1894019164 wait complete. 2024-08-15T17:54:36.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:36.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.439+0000 7f39ba23b700 1 Processor -- start 2024-08-15T17:54:36.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.439+0000 7f39ba23b700 1 -- start start 2024-08-15T17:54:36.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.439+0000 7f39ba23b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39b4159240 0x7f39b40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.439+0000 7f39ba23b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159610 0x7f39b40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40c7dc0 con 0x7f39b40c6c80 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b406c170 con 0x7f39b4159240 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c71b0 con 0x7f39b4159610 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b37fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39b4159240 0x7f39b40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159610 0x7f39b40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39aaffd700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f39b40c6c80 0x7f39b406ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:35604/0 (socket says 172.21.15.33:35604) 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39aaffd700 1 -- 172.21.15.33:0/3925013052 learned_addr learned my addr 172.21.15.33:0/3925013052 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b2ffd700 1 -- 172.21.15.33:0/3925013052 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674448301 0 0) 0x7f39b40c7dc0 con 0x7f39b40c6c80 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b2ffd700 1 -- 172.21.15.33:0/3925013052 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a0003570 con 0x7f39b40c6c80 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b3fff700 1 -- 172.21.15.33:0/3925013052 >> v2:172.21.15.105:3300/0 conn(0x7f39b4159240 msgr2=0x7f39b40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:36.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b3fff700 1 --2- 172.21.15.33:0/3925013052 >> v2:172.21.15.105:3300/0 conn(0x7f39b4159240 0x7f39b40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b3fff700 1 -- 172.21.15.33:0/3925013052 >> v1:172.21.15.105:6789/0 conn(0x7f39b40c6c80 legacy=0x7f39b406ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b3fff700 1 -- 172.21.15.33:0/3925013052 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40c7490 con 0x7f39b4159610 2024-08-15T17:54:36.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b3fff700 1 --2- 172.21.15.33:0/3925013052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159610 0x7f39b40686a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009e60 tx=0x7f39ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5171df8a504fd7ad server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b2ffd700 1 -- 172.21.15.33:0/3925013052 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00e070 con 0x7f39b4159610 2024-08-15T17:54:36.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b2ffd700 1 -- 172.21.15.33:0/3925013052 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac00bab0 con 0x7f39b4159610 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39b2ffd700 1 -- 172.21.15.33:0/3925013052 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00be30 con 0x7f39b4159610 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- 172.21.15.33:0/3925013052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159610 msgr2=0x7f39b40686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3925013052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159610 0x7f39b40686a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009e60 tx=0x7f39ac009780 comp rx=0 tx=0).stop 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- 172.21.15.33:0/3925013052 shutdown_connections 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3925013052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159610 0x7f39b40686a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3925013052 >> v2:172.21.15.105:3300/0 conn(0x7f39b4159240 0x7f39b40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- 172.21.15.33:0/3925013052 >> 172.21.15.33:0/3925013052 conn(0x7f39b40c9c20 msgr2=0x7f39b406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- 172.21.15.33:0/3925013052 shutdown_connections 2024-08-15T17:54:36.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.443+0000 7f39ba23b700 1 -- 172.21.15.33:0/3925013052 wait complete. 2024-08-15T17:54:36.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 Processor -- start 2024-08-15T17:54:36.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 -- start start 2024-08-15T17:54:36.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b40c6c80 0x7f39b40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159240 0x7f39b4154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 0x7f39b40c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4154890 con 0x7f39b4159610 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40a6de0 con 0x7f39b40c6c80 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39ba23b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c5ef0 con 0x7f39b4159240 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 0x7f39b40c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 0x7f39b40c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59904/0 (socket says 172.21.15.33:59904) 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39b3fff700 1 -- 172.21.15.33:0/3766148206 learned_addr learned my addr 172.21.15.33:0/3766148206 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39aaffd700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159240 0x7f39b4154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.447+0000 7f39b37fe700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b40c6c80 0x7f39b40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b3fff700 1 -- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159240 msgr2=0x7f39b4154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b3fff700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159240 0x7f39b4154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b3fff700 1 -- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b40c6c80 msgr2=0x7f39b40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b3fff700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b40c6c80 0x7f39b40a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b3fff700 1 -- 172.21.15.33:0/3766148206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009a20 con 0x7f39b4159610 2024-08-15T17:54:36.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b3fff700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 0x7f39b40c6280 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39b406c2b0 tx=0x7f39ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac012c40 con 0x7f39b4159610 2024-08-15T17:54:36.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac021070 con 0x7f39b4159610 2024-08-15T17:54:36.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac026430 con 0x7f39b4159610 2024-08-15T17:54:36.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40c67c0 con 0x7f39b4159610 2024-08-15T17:54:36.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40a64b0 con 0x7f39b4159610 2024-08-15T17:54:36.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b40a6f70 con 0x7f39b4159610 2024-08-15T17:54:36.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f39ac023030 con 0x7f39b4159610 2024-08-15T17:54:36.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39abfff700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3994060860 0x7f3994062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f39ac07e8d0 con 0x7f39b4159610 2024-08-15T17:54:36.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.451+0000 7f39b37fe700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3994060860 0x7f3994062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.455+0000 7f39b37fe700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3994060860 0x7f3994062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009db0 tx=0x7f39a40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.459+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f39ac04f070 con 0x7f39b4159610 2024-08-15T17:54:36.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.627+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b40645c0 con 0x7f39b4159610 2024-08-15T17:54:36.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39abfff700 1 -- 172.21.15.33:0/3766148206 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f39ac052690 con 0x7f39b4159610 2024-08-15T17:54:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:36.631 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":29,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:54:33.692618+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:36.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3994060860 msgr2=0x7f3994062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3994060860 0x7f3994062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009db0 tx=0x7f39a40091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 msgr2=0x7f39b40c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 0x7f39b40c6280 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39b406c2b0 tx=0x7f39ac019000 comp rx=0 tx=0).stop 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 shutdown_connections 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3994060860 0x7f3994062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b4159610 0x7f39b40c6280 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b4159240 0x7f39b4154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 --2- 172.21.15.33:0/3766148206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b40c6c80 0x7f39b40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 >> 172.21.15.33:0/3766148206 conn(0x7f39b40c9c20 msgr2=0x7f39b40b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 shutdown_connections 2024-08-15T17:54:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.631+0000 7f39ba23b700 1 -- 172.21.15.33:0/3766148206 wait complete. 2024-08-15T17:54:36.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-15T17:54:36.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:54:36.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 Processor -- start 2024-08-15T17:54:36.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 -- start start 2024-08-15T17:54:36.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85881596d0 0x7f8588066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f858815dbc0 0x7f8588067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85880cba90 con 0x7f8588159300 2024-08-15T17:54:36.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85880b2b60 con 0x7f858815dbc0 2024-08-15T17:54:36.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.755+0000 7f858e272700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85880b2940 con 0x7f85881596d0 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8587fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8588159300 0x7f85880b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60726/0 (socket says 172.21.15.33:60726) 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8587fff700 1 -- 172.21.15.33:0/1050437231 learned_addr learned my addr 172.21.15.33:0/1050437231 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f85877fe700 1 --2- 172.21.15.33:0/1050437231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85881596d0 0x7f8588066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858c80f700 1 --2- 172.21.15.33:0/1050437231 >> v2:172.21.15.105:3300/0 conn(0x7f858815dbc0 0x7f8588067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8586ffd700 1 -- 172.21.15.33:0/1050437231 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229085997 0 0) 0x7f85880cba90 con 0x7f8588159300 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8586ffd700 1 -- 172.21.15.33:0/1050437231 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8570003570 con 0x7f8588159300 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f85877fe700 1 -- 172.21.15.33:0/1050437231 >> v2:172.21.15.105:3300/0 conn(0x7f858815dbc0 msgr2=0x7f8588067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f85877fe700 1 --2- 172.21.15.33:0/1050437231 >> v2:172.21.15.105:3300/0 conn(0x7f858815dbc0 0x7f8588067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f85877fe700 1 -- 172.21.15.33:0/1050437231 >> v1:172.21.15.33:6789/0 conn(0x7f8588159300 legacy=0x7f85880b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f85877fe700 1 -- 172.21.15.33:0/1050437231 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85880cb160 con 0x7f85881596d0 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f85877fe700 1 --2- 172.21.15.33:0/1050437231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85881596d0 0x7f8588066e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85780098e0 tx=0x7f85780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4717f991d1de9b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8586ffd700 1 -- 172.21.15.33:0/1050437231 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578011630 con 0x7f85881596d0 2024-08-15T17:54:36.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8586ffd700 1 -- 172.21.15.33:0/1050437231 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8578011790 con 0x7f85881596d0 2024-08-15T17:54:36.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f8586ffd700 1 -- 172.21.15.33:0/1050437231 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578011b30 con 0x7f85881596d0 2024-08-15T17:54:36.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 -- 172.21.15.33:0/1050437231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85881596d0 msgr2=0x7f8588066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 --2- 172.21.15.33:0/1050437231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85881596d0 0x7f8588066e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85780098e0 tx=0x7f85780091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 -- 172.21.15.33:0/1050437231 shutdown_connections 2024-08-15T17:54:36.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 --2- 172.21.15.33:0/1050437231 >> v2:172.21.15.105:3300/0 conn(0x7f858815dbc0 0x7f8588067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 --2- 172.21.15.33:0/1050437231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85881596d0 0x7f8588066e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 -- 172.21.15.33:0/1050437231 >> 172.21.15.33:0/1050437231 conn(0x7f85880682c0 msgr2=0x7f85880686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:36.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 -- 172.21.15.33:0/1050437231 shutdown_connections 2024-08-15T17:54:36.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.759+0000 7f858e272700 1 -- 172.21.15.33:0/1050437231 wait complete. 2024-08-15T17:54:36.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 Processor -- start 2024-08-15T17:54:36.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 -- start start 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 0x7f858814d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85881596d0 0x7f85880b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f858815dbc0 0x7f85880b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588149120 con 0x7f8588159300 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588149400 con 0x7f85881596d0 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85881496e0 con 0x7f858815dbc0 2024-08-15T17:54:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 0x7f858814d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 0x7f858814d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59920/0 (socket says 172.21.15.33:59920) 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 -- 172.21.15.33:0/1331028029 learned_addr learned my addr 172.21.15.33:0/1331028029 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858c80f700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f858815dbc0 0x7f85880b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f85877fe700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85881596d0 0x7f85880b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 -- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f858815dbc0 msgr2=0x7f85880b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f858815dbc0 0x7f85880b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 -- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85881596d0 msgr2=0x7f85880b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85881596d0 0x7f85880b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 -- 172.21.15.33:0/1331028029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578009420 con 0x7f8588159300 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858c80f700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f858815dbc0 0x7f85880b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f85877fe700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85881596d0 0x7f85880b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f8587fff700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 0x7f858814d1e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c7c0 tx=0x7f857c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c005b30 con 0x7f8588159300 2024-08-15T17:54:36.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c005c90 con 0x7f8588159300 2024-08-15T17:54:36.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85881499c0 con 0x7f8588159300 2024-08-15T17:54:36.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c007340 con 0x7f8588159300 2024-08-15T17:54:36.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.763+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858814a1c0 con 0x7f8588159300 2024-08-15T17:54:36.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.767+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8588149ec0 con 0x7f8588159300 2024-08-15T17:54:36.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.767+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f857c025430 con 0x7f8588159300 2024-08-15T17:54:36.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.767+0000 7f856ffff700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8574060860 0x7f8574062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:36.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.767+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f857c07cd90 con 0x7f8588159300 2024-08-15T17:54:36.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.767+0000 7f85877fe700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8574060860 0x7f8574062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:36.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.771+0000 7f85877fe700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8574060860 0x7f8574062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f85880c3810 tx=0x7f8578017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:36.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.775+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f857c04d690 con 0x7f8588159300 2024-08-15T17:54:36.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.935+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85880645c0 con 0x7f8588159300 2024-08-15T17:54:36.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f856ffff700 1 -- 172.21.15.33:0/1331028029 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f857c050cb0 con 0x7f8588159300 2024-08-15T17:54:36.939 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:54:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8574060860 msgr2=0x7f8574062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8574060860 0x7f8574062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f85880c3810 tx=0x7f8578017000 comp rx=0 tx=0).stop 2024-08-15T17:54:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 msgr2=0x7f858814d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 0x7f858814d1e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c7c0 tx=0x7f857c007e00 comp rx=0 tx=0).stop 2024-08-15T17:54:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 shutdown_connections 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8574060860 0x7f8574062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85881596d0 0x7f85880b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f858815dbc0 0x7f85880b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 --2- 172.21.15.33:0/1331028029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8588159300 0x7f858814d1e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 >> 172.21.15.33:0/1331028029 conn(0x7f85880682c0 msgr2=0x7f85880c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 shutdown_connections 2024-08-15T17:54:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:36.939+0000 7f858e272700 1 -- 172.21.15.33:0/1331028029 wait complete. 2024-08-15T17:54:36.953 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-15T17:54:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 Processor -- start 2024-08-15T17:54:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 -- start start 2024-08-15T17:54:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60980682a0 0x7f6098068b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6098066e00 0x7f6098155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6098068670 con 0x7f60981558d0 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609806b6d0 con 0x7f60980682a0 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609806b3f0 con 0x7f6098066e00 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60980682a0 0x7f6098068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60980682a0 0x7f6098068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59936/0 (socket says 172.21.15.33:59936) 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 -- 172.21.15.33:0/2283622500 learned_addr learned my addr 172.21.15.33:0/2283622500 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d1bc700 1 --1- 172.21.15.33:0/2283622500 >> v1:172.21.15.33:6789/0 conn(0x7f60981558d0 0x7f60980c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60728/0 (socket says 172.21.15.33:60728) 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f6097fff700 1 --2- 172.21.15.33:0/2283622500 >> v2:172.21.15.105:3300/0 conn(0x7f6098066e00 0x7f6098155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 -- 172.21.15.33:0/2283622500 >> v2:172.21.15.105:3300/0 conn(0x7f6098066e00 msgr2=0x7f6098155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 --2- 172.21.15.33:0/2283622500 >> v2:172.21.15.105:3300/0 conn(0x7f6098066e00 0x7f6098155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 -- 172.21.15.33:0/2283622500 >> v1:172.21.15.33:6789/0 conn(0x7f60981558d0 legacy=0x7f60980c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 -- 172.21.15.33:0/2283622500 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980677c0 con 0x7f60980682a0 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609c9bb700 1 --2- 172.21.15.33:0/2283622500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60980682a0 0x7f6098068b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f60980b1a30 tx=0x7f608c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ad51b156e92faf server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f60977fe700 1 -- 172.21.15.33:0/2283622500 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c009e70 con 0x7f60980682a0 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f60977fe700 1 -- 172.21.15.33:0/2283622500 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00b860 con 0x7f60980682a0 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f60977fe700 1 -- 172.21.15.33:0/2283622500 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00bc00 con 0x7f60980682a0 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 -- 172.21.15.33:0/2283622500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60980682a0 msgr2=0x7f6098068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.059+0000 7f609d9bd700 1 --2- 172.21.15.33:0/2283622500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60980682a0 0x7f6098068b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f60980b1a30 tx=0x7f608c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- 172.21.15.33:0/2283622500 shutdown_connections 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 --2- 172.21.15.33:0/2283622500 >> v2:172.21.15.105:3300/0 conn(0x7f6098066e00 0x7f6098155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 --2- 172.21.15.33:0/2283622500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60980682a0 0x7f6098068b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- 172.21.15.33:0/2283622500 >> 172.21.15.33:0/2283622500 conn(0x7f60980ccfc0 msgr2=0x7f60980c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- 172.21.15.33:0/2283622500 shutdown_connections 2024-08-15T17:54:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- 172.21.15.33:0/2283622500 wait complete. 2024-08-15T17:54:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 Processor -- start 2024-08-15T17:54:37.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- start start 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6098066e00 0x7f60980c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60980682a0 0x7f609813c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 0x7f6098169300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60980c2350 con 0x7f60981558d0 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609813c9e0 con 0x7f6098066e00 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.063+0000 7f609d9bd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609816a4d0 con 0x7f60980682a0 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 0x7f6098169300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f6097fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60980682a0 0x7f609813c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609c9bb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6098066e00 0x7f60980c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 0x7f6098169300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59938/0 (socket says 172.21.15.33:59938) 2024-08-15T17:54:37.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f6097fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60980682a0 0x7f609813c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:42494/0 (socket says 172.21.15.33:42494) 2024-08-15T17:54:37.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 -- 172.21.15.33:0/753112505 learned_addr learned my addr 172.21.15.33:0/753112505 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 -- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60980682a0 msgr2=0x7f609813c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60980682a0 0x7f609813c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 -- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6098066e00 msgr2=0x7f60980c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6098066e00 0x7f60980c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 -- 172.21.15.33:0/753112505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0094f0 con 0x7f60981558d0 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d1bc700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 0x7f6098169300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f608800c4e0 tx=0x7f6088007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800ce50 con 0x7f60981558d0 2024-08-15T17:54:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6088007360 con 0x7f60981558d0 2024-08-15T17:54:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609813dbf0 con 0x7f60981558d0 2024-08-15T17:54:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088007700 con 0x7f60981558d0 2024-08-15T17:54:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6098169af0 con 0x7f60981558d0 2024-08-15T17:54:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.067+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609813dd80 con 0x7f60981558d0 2024-08-15T17:54:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.071+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6088004a40 con 0x7f60981558d0 2024-08-15T17:54:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.071+0000 7f6094ff9700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6084060890 0x7f6084062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.071+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f608807c380 con 0x7f60981558d0 2024-08-15T17:54:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.071+0000 7f609c9bb700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6084060890 0x7f6084062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.071+0000 7f609c9bb700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6084060890 0x7f6084062d40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60980b1a30 tx=0x7f608c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:37.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.079+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f608804cb00 con 0x7f60981558d0 2024-08-15T17:54:37.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.243+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60980638f0 con 0x7f60981558d0 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.243+0000 7f6094ff9700 1 -- 172.21.15.33:0/753112505 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6088050120 con 0x7f60981558d0 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:37.245 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-08-15T17:54:37.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6084060890 msgr2=0x7f6084062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6084060890 0x7f6084062d40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60980b1a30 tx=0x7f608c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 msgr2=0x7f6098169300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 0x7f6098169300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f608800c4e0 tx=0x7f6088007f20 comp rx=0 tx=0).stop 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 shutdown_connections 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6084060890 0x7f6084062d40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60981558d0 0x7f6098169300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60980682a0 0x7f609813c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 --2- 172.21.15.33:0/753112505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6098066e00 0x7f60980c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 >> 172.21.15.33:0/753112505 conn(0x7f60980ccfc0 msgr2=0x7f60980b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 shutdown_connections 2024-08-15T17:54:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.247+0000 7f609d9bd700 1 -- 172.21.15.33:0/753112505 wait complete. 2024-08-15T17:54:37.259 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-15T17:54:37.259 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-15T17:54:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.367+0000 7f103f0a9700 1 Processor -- start 2024-08-15T17:54:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.367+0000 7f103f0a9700 1 -- start start 2024-08-15T17:54:37.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10380b11f0 0x7f103815a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f10380aedc0 0x7f1038162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10380b0770 con 0x7f10381537e0 2024-08-15T17:54:37.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1038153bb0 con 0x7f10380b11f0 2024-08-15T17:54:37.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103815a640 con 0x7f10380aedc0 2024-08-15T17:54:37.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10380b11f0 0x7f103815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10380b11f0 0x7f103815a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59948/0 (socket says 172.21.15.33:59948) 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 -- 172.21.15.33:0/18632341 learned_addr learned my addr 172.21.15.33:0/18632341 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103e8a8700 1 --2- 172.21.15.33:0/18632341 >> v2:172.21.15.105:3300/0 conn(0x7f10380aedc0 0x7f1038162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 -- 172.21.15.33:0/18632341 >> v2:172.21.15.105:3300/0 conn(0x7f10380aedc0 msgr2=0x7f1038162cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 --2- 172.21.15.33:0/18632341 >> v2:172.21.15.105:3300/0 conn(0x7f10380aedc0 0x7f1038162cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 -- 172.21.15.33:0/18632341 >> v1:172.21.15.105:6789/0 conn(0x7f10381537e0 legacy=0x7f10380b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 -- 172.21.15.33:0/18632341 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380af960 con 0x7f10380b11f0 2024-08-15T17:54:37.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d8a6700 1 --2- 172.21.15.33:0/18632341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103815a100 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f103808a0c0 tx=0x7f1034009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfe1c84600e14f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:37.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d0a5700 1 -- 172.21.15.33:0/18632341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400b860 con 0x7f10380b11f0 2024-08-15T17:54:37.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d0a5700 1 -- 172.21.15.33:0/18632341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400b9c0 con 0x7f10380b11f0 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103d0a5700 1 -- 172.21.15.33:0/18632341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400bd60 con 0x7f10380b11f0 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- 172.21.15.33:0/18632341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 msgr2=0x7f103815a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 --2- 172.21.15.33:0/18632341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103815a100 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f103808a0c0 tx=0x7f1034009250 comp rx=0 tx=0).stop 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- 172.21.15.33:0/18632341 shutdown_connections 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 --2- 172.21.15.33:0/18632341 >> v2:172.21.15.105:3300/0 conn(0x7f10380aedc0 0x7f1038162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 --2- 172.21.15.33:0/18632341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103815a100 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- 172.21.15.33:0/18632341 >> 172.21.15.33:0/18632341 conn(0x7f1038067590 msgr2=0x7f10380d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- 172.21.15.33:0/18632341 shutdown_connections 2024-08-15T17:54:37.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.371+0000 7f103f0a9700 1 -- 172.21.15.33:0/18632341 wait complete. 2024-08-15T17:54:37.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 Processor -- start 2024-08-15T17:54:37.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 -- start start 2024-08-15T17:54:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10380aedc0 0x7f1038152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103816cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10381537e0 0x7f10380b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1038153170 con 0x7f10380b11f0 2024-08-15T17:54:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1038155700 con 0x7f10380aedc0 2024-08-15T17:54:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103f0a9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103816d6d0 con 0x7f10381537e0 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103816cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103816cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59956/0 (socket says 172.21.15.33:59956) 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 -- 172.21.15.33:0/481261466 learned_addr learned my addr 172.21.15.33:0/481261466 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103e0a7700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10380aedc0 0x7f1038152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103e8a8700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10381537e0 0x7f10380b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 -- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10381537e0 msgr2=0x7f10380b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10381537e0 0x7f10380b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 -- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10380aedc0 msgr2=0x7f1038152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10380aedc0 0x7f1038152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.375+0000 7f103d8a6700 1 -- 172.21.15.33:0/481261466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340094f0 con 0x7f10380b11f0 2024-08-15T17:54:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f103d8a6700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103816cc50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1034009290 tx=0x7f1034017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:37.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034011e60 con 0x7f10380b11f0 2024-08-15T17:54:37.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103401a630 con 0x7f10380b11f0 2024-08-15T17:54:37.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103816d9b0 con 0x7f10380b11f0 2024-08-15T17:54:37.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103401a9f0 con 0x7f10380b11f0 2024-08-15T17:54:37.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10380cf390 con 0x7f10380b11f0 2024-08-15T17:54:37.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10381558b0 con 0x7f10380b11f0 2024-08-15T17:54:37.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1034026450 con 0x7f10380b11f0 2024-08-15T17:54:37.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f102e7fc700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f101c060890 0x7f101c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f103407e650 con 0x7f10380b11f0 2024-08-15T17:54:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.379+0000 7f103e0a7700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f101c060890 0x7f101c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.383+0000 7f103e0a7700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f101c060890 0x7f101c062d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1028000c00 tx=0x7f1028009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.387+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f10381558b0 con 0x7f10380b11f0 2024-08-15T17:54:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.550+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1038155870 con 0x7f10380b11f0 2024-08-15T17:54:37.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.946+0000 7f102e7fc700 1 -- 172.21.15.33:0/481261466 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f103404ef20 con 0x7f10380b11f0 2024-08-15T17:54:37.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f101c060890 msgr2=0x7f101c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f101c060890 0x7f101c062d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1028000c00 tx=0x7f1028009040 comp rx=0 tx=0).stop 2024-08-15T17:54:37.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 msgr2=0x7f103816cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:37.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103816cc50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1034009290 tx=0x7f1034017000 comp rx=0 tx=0).stop 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 shutdown_connections 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f101c060890 0x7f101c062d40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10381537e0 0x7f10380b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10380b11f0 0x7f103816cc50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 --2- 172.21.15.33:0/481261466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10380aedc0 0x7f1038152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 >> 172.21.15.33:0/481261466 conn(0x7f1038067590 msgr2=0x7f10381584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:37.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 shutdown_connections 2024-08-15T17:54:37.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:37.954+0000 7f103f0a9700 1 -- 172.21.15.33:0/481261466 wait complete. 2024-08-15T17:54:37.959 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-08-15T17:54:37.971 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-15T17:54:38.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.086+0000 7f003e004700 1 Processor -- start 2024-08-15T17:54:38.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.086+0000 7f003e004700 1 -- start start 2024-08-15T17:54:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f003e004700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f00380688d0 0x7f0038068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f003e004700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f003e004700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003806b750 con 0x7f0038069b70 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f003e004700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003806b9b0 con 0x7f00380688d0 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f003e004700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003806bc90 con 0x7f00380ae6d0 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f00380688d0 0x7f0038068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f00380688d0 0x7f0038068ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58110/0 (socket says 172.21.15.33:58110) 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 -- 172.21.15.33:0/1475607921 learned_addr learned my addr 172.21.15.33:0/1475607921 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f002ffff700 1 --2- 172.21.15.33:0/1475607921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 -- 172.21.15.33:0/1475607921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 msgr2=0x7f00380aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f0036ffd700 1 -- 172.21.15.33:0/1475607921 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811263165 0 0) 0x7f003806b750 con 0x7f0038069b70 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 --2- 172.21.15.33:0/1475607921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 -- 172.21.15.33:0/1475607921 >> v1:172.21.15.105:6789/0 conn(0x7f0038069b70 legacy=0x7f0038069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:38.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 -- 172.21.15.33:0/1475607921 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003806bf70 con 0x7f00380688d0 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f00377fe700 1 --2- 172.21.15.33:0/1475607921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380688d0 0x7f0038068ca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f00280099b0 tx=0x7f0028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c057d48a8ef131 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f0036ffd700 1 -- 172.21.15.33:0/1475607921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028009ea0 con 0x7f00380688d0 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f0036ffd700 1 -- 172.21.15.33:0/1475607921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002800b860 con 0x7f00380688d0 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.090+0000 7f0036ffd700 1 -- 172.21.15.33:0/1475607921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002800bc00 con 0x7f00380688d0 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 -- 172.21.15.33:0/1475607921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380688d0 msgr2=0x7f0038068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 --2- 172.21.15.33:0/1475607921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380688d0 0x7f0038068ca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f00280099b0 tx=0x7f0028009250 comp rx=0 tx=0).stop 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 -- 172.21.15.33:0/1475607921 shutdown_connections 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 --2- 172.21.15.33:0/1475607921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 --2- 172.21.15.33:0/1475607921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380688d0 0x7f0038068ca0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 -- 172.21.15.33:0/1475607921 >> 172.21.15.33:0/1475607921 conn(0x7f003806db30 msgr2=0x7f003806df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:38.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 -- 172.21.15.33:0/1475607921 shutdown_connections 2024-08-15T17:54:38.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 -- 172.21.15.33:0/1475607921 wait complete. 2024-08-15T17:54:38.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 Processor -- start 2024-08-15T17:54:38.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.094+0000 7f003e004700 1 -- start start 2024-08-15T17:54:38.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00380688d0 0x7f00380c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:38.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038069b70 0x7f0038144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:38.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:38.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0038144c90 con 0x7f0038069b70 2024-08-15T17:54:38.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c54d0 con 0x7f00380688d0 2024-08-15T17:54:38.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c57b0 con 0x7f00380ae6d0 2024-08-15T17:54:38.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f00377fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00380688d0 0x7f00380c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:38.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f0037fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:38.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038069b70 0x7f0038144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f0037fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:46192/0 (socket says 172.21.15.33:46192) 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f0037fff700 1 -- 172.21.15.33:0/2725349158 learned_addr learned my addr 172.21.15.33:0/2725349158 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 -- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 msgr2=0x7f00380c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 -- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00380688d0 msgr2=0x7f00380c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00380688d0 0x7f00380c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 -- 172.21.15.33:0/2725349158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00280094f0 con 0x7f0038069b70 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002ffff700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038069b70 0x7f0038144320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f002000e900 tx=0x7f00200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020013680 con 0x7f0038069b70 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00200137e0 con 0x7f0038069b70 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020013ba0 con 0x7f0038069b70 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00380c5a90 con 0x7f0038069b70 2024-08-15T17:54:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.098+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00380c6050 con 0x7f0038069b70 2024-08-15T17:54:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.102+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00380645c0 con 0x7f0038069b70 2024-08-15T17:54:38.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.102+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f00200253d0 con 0x7f0038069b70 2024-08-15T17:54:38.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.102+0000 7f002f7fe700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0018060860 0x7f0018062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:38.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.102+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f002007d210 con 0x7f0038069b70 2024-08-15T17:54:38.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.102+0000 7f00377fe700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0018060860 0x7f0018062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:38.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.102+0000 7f00377fe700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0018060860 0x7f0018062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f00280099b0 tx=0x7f0028017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:38.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.110+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f002004d8a0 con 0x7f0038069b70 2024-08-15T17:54:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.278+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f00380b0e00 con 0x7f0038069b70 2024-08-15T17:54:38.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.962+0000 7f002f7fe700 1 -- 172.21.15.33:0/2725349158 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0020050ec0 con 0x7f0038069b70 2024-08-15T17:54:38.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0018060860 msgr2=0x7f0018062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:38.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0018060860 0x7f0018062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f00280099b0 tx=0x7f0028017000 comp rx=0 tx=0).stop 2024-08-15T17:54:38.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038069b70 msgr2=0x7f0038144320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:38.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038069b70 0x7f0038144320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f002000e900 tx=0x7f00200091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 shutdown_connections 2024-08-15T17:54:38.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0018060860 0x7f0018062d10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380ae6d0 0x7f00380c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038069b70 0x7f0038144320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 --2- 172.21.15.33:0/2725349158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00380688d0 0x7f00380c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 >> 172.21.15.33:0/2725349158 conn(0x7f003806db30 msgr2=0x7f00380b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 shutdown_connections 2024-08-15T17:54:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:38.982+0000 7f003e004700 1 -- 172.21.15.33:0/2725349158 wait complete. 2024-08-15T17:54:38.987 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-08-15T17:54:38.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-15T17:54:39.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 Processor -- start 2024-08-15T17:54:39.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 -- start start 2024-08-15T17:54:39.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f831c158f90 0x7f831c13c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:39.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c0b0ce0 0x7f831c0b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:39.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c069650 con 0x7f831c159360 2024-08-15T17:54:39.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0b16a0 con 0x7f831c158f90 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8322083700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0687a0 con 0x7f831c0b0ce0 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8320880700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f831c159360 0x7f831c0afc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53866/0 (socket says 172.21.15.33:53866) 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8320880700 1 -- 172.21.15.33:0/3004347241 learned_addr learned my addr 172.21.15.33:0/3004347241 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321081700 1 --2- 172.21.15.33:0/3004347241 >> v2:172.21.15.105:3300/0 conn(0x7f831c158f90 0x7f831c13c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321882700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c0b0ce0 0x7f831c0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8313fff700 1 -- 172.21.15.33:0/3004347241 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204308637 0 0) 0x7f831c069650 con 0x7f831c159360 2024-08-15T17:54:39.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8313fff700 1 -- 172.21.15.33:0/3004347241 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8308003570 con 0x7f831c159360 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8313fff700 1 -- 172.21.15.33:0/3004347241 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129621270 0 0) 0x7f8308003570 con 0x7f831c159360 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321081700 1 -- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c0b0ce0 msgr2=0x7f831c0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321081700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c0b0ce0 0x7f831c0b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321081700 1 -- 172.21.15.33:0/3004347241 >> v1:172.21.15.33:6789/0 conn(0x7f831c159360 legacy=0x7f831c0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321081700 1 -- 172.21.15.33:0/3004347241 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c068a40 con 0x7f831c158f90 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321882700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c0b0ce0 0x7f831c0b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8321081700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c158f90 0x7f831c13c890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83180098e0 tx=0x7f83180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeadbe326690990f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8313fff700 1 -- 172.21.15.33:0/3004347241 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c001470 con 0x7f831c158f90 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8313fff700 1 -- 172.21.15.33:0/3004347241 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8318011420 con 0x7f831c158f90 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.106+0000 7f8313fff700 1 -- 172.21.15.33:0/3004347241 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180117a0 con 0x7f831c158f90 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 -- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c158f90 msgr2=0x7f831c13c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c158f90 0x7f831c13c890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83180098e0 tx=0x7f83180091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 -- 172.21.15.33:0/3004347241 shutdown_connections 2024-08-15T17:54:39.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c0b0ce0 0x7f831c0b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 --2- 172.21.15.33:0/3004347241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c158f90 0x7f831c13c890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 -- 172.21.15.33:0/3004347241 >> 172.21.15.33:0/3004347241 conn(0x7f831c0ce990 msgr2=0x7f831c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:39.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 -- 172.21.15.33:0/3004347241 shutdown_connections 2024-08-15T17:54:39.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 -- 172.21.15.33:0/3004347241 wait complete. 2024-08-15T17:54:39.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 Processor -- start 2024-08-15T17:54:39.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.110+0000 7f8322083700 1 -- start start 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c0b0ce0 0x7f831c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c158f90 0x7f831c13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 0x7f831c145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0ca0f0 con 0x7f831c159360 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0ca390 con 0x7f831c0b0ce0 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0ca670 con 0x7f831c158f90 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 0x7f831c145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 0x7f831c145460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58128/0 (socket says 172.21.15.33:58128) 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 -- 172.21.15.33:0/3099011382 learned_addr learned my addr 172.21.15.33:0/3099011382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:39.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8320880700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c158f90 0x7f831c13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321081700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c0b0ce0 0x7f831c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 -- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c158f90 msgr2=0x7f831c13c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c158f90 0x7f831c13c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 -- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c0b0ce0 msgr2=0x7f831c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c0b0ce0 0x7f831c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 -- 172.21.15.33:0/3099011382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314009a20 con 0x7f831c159360 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8321882700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 0x7f831c145460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8314009fc0 tx=0x7f831400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400cbd0 con 0x7f831c159360 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400f040 con 0x7f831c159360 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8318009420 con 0x7f831c159360 2024-08-15T17:54:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314014480 con 0x7f831c159360 2024-08-15T17:54:39.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.114+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c0cac30 con 0x7f831c159360 2024-08-15T17:54:39.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.118+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c064330 con 0x7f831c159360 2024-08-15T17:54:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.118+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8314003020 con 0x7f831c159360 2024-08-15T17:54:39.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.118+0000 7f83117fa700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8300060860 0x7f8300062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:39.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.118+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f831407d460 con 0x7f831c159360 2024-08-15T17:54:39.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.118+0000 7f8321081700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8300060860 0x7f8300062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:39.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.118+0000 7f8321081700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8300060860 0x7f8300062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83180091e0 tx=0x7f8318016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.126+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f831404d910 con 0x7f831c159360 2024-08-15T17:54:39.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.326+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f831c157330 con 0x7f831c159360 2024-08-15T17:54:39.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.978+0000 7f83117fa700 1 -- 172.21.15.33:0/3099011382 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8314050f30 con 0x7f831c159360 2024-08-15T17:54:39.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8300060860 msgr2=0x7f8300062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:39.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8300060860 0x7f8300062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83180091e0 tx=0x7f8318016000 comp rx=0 tx=0).stop 2024-08-15T17:54:39.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 msgr2=0x7f831c145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:39.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 0x7f831c145460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8314009fc0 tx=0x7f831400b040 comp rx=0 tx=0).stop 2024-08-15T17:54:39.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 shutdown_connections 2024-08-15T17:54:39.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8300060860 0x7f8300062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831c159360 0x7f831c145460 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f831c158f90 0x7f831c13c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 --2- 172.21.15.33:0/3099011382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f831c0b0ce0 0x7f831c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 >> 172.21.15.33:0/3099011382 conn(0x7f831c0ce990 msgr2=0x7f831c156470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 shutdown_connections 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:39.990+0000 7f8322083700 1 -- 172.21.15.33:0/3099011382 wait complete. 2024-08-15T17:54:39.993 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 4 and data pool 5 2024-08-15T17:54:40.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:40.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.102+0000 7f0ef5068700 1 Processor -- start 2024-08-15T17:54:40.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.102+0000 7f0ef5068700 1 -- start start 2024-08-15T17:54:40.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.102+0000 7f0ef5068700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ef006e620 0x7f0ef00ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.102+0000 7f0ef5068700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00af2b0 con 0x7f0ef00b0350 2024-08-15T17:54:40.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.102+0000 7f0ef5068700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00af590 con 0x7f0ef0155d20 2024-08-15T17:54:40.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.102+0000 7f0ef5068700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef00b07a0 con 0x7f0ef006e620 2024-08-15T17:54:40.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef4867700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ef006e620 0x7f0ef00ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0eef7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0ef00b0350 0x7f0ef006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53880/0 (socket says 172.21.15.33:53880) 2024-08-15T17:54:40.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0eef7fe700 1 -- 172.21.15.33:0/2207833298 learned_addr learned my addr 172.21.15.33:0/2207833298 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:40.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef4867700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ef006e620 0x7f0ef00ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58130/0 (socket says 172.21.15.33:58130) 2024-08-15T17:54:40.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef4867700 1 -- 172.21.15.33:0/2207833298 >> v1:172.21.15.105:6789/0 conn(0x7f0ef0155d20 legacy=0x7f0ef00aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef4867700 1 -- 172.21.15.33:0/2207833298 >> v1:172.21.15.33:6789/0 conn(0x7f0ef00b0350 legacy=0x7f0ef006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef4867700 1 -- 172.21.15.33:0/2207833298 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00af870 con 0x7f0ef006e620 2024-08-15T17:54:40.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef4867700 1 --2- 172.21.15.33:0/2207833298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef006e620 0x7f0ef00ad7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009e60 tx=0x7f0ee8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da84d943a5980a4b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0eeeffd700 1 -- 172.21.15.33:0/2207833298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800e070 con 0x7f0ef006e620 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0eeeffd700 1 -- 172.21.15.33:0/2207833298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800bc30 con 0x7f0ef006e620 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0eeeffd700 1 -- 172.21.15.33:0/2207833298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8012430 con 0x7f0ef006e620 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 -- 172.21.15.33:0/2207833298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef006e620 msgr2=0x7f0ef00ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 --2- 172.21.15.33:0/2207833298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef006e620 0x7f0ef00ad7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009e60 tx=0x7f0ee8009780 comp rx=0 tx=0).stop 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 -- 172.21.15.33:0/2207833298 shutdown_connections 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 --2- 172.21.15.33:0/2207833298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef006e620 0x7f0ef00ad7c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 -- 172.21.15.33:0/2207833298 >> 172.21.15.33:0/2207833298 conn(0x7f0ef00678d0 msgr2=0x7f0ef0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 -- 172.21.15.33:0/2207833298 shutdown_connections 2024-08-15T17:54:40.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.106+0000 7f0ef5068700 1 -- 172.21.15.33:0/2207833298 wait complete. 2024-08-15T17:54:40.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 Processor -- start 2024-08-15T17:54:40.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 -- start start 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ef006e620 0x7f0ef014b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ef00b0350 0x7f0ef014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 0x7f0ef0063290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef014b130 con 0x7f0ef0155d20 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0149fe0 con 0x7f0ef006e620 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef5068700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0149a20 con 0x7f0ef00b0350 2024-08-15T17:54:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef4867700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 0x7f0ef0063290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef4867700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 0x7f0ef0063290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58140/0 (socket says 172.21.15.33:58140) 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0ef4867700 1 -- 172.21.15.33:0/4245579823 learned_addr learned my addr 172.21.15.33:0/4245579823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0eeffff700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ef006e620 0x7f0ef014b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.110+0000 7f0eef7fe700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ef00b0350 0x7f0ef014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef4867700 1 -- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ef00b0350 msgr2=0x7f0ef014c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef4867700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ef00b0350 0x7f0ef014c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef4867700 1 -- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ef006e620 msgr2=0x7f0ef014b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef4867700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ef006e620 0x7f0ef014b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef4867700 1 -- 172.21.15.33:0/4245579823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009a20 con 0x7f0ef0155d20 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef4867700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 0x7f0ef0063290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097c0 tx=0x7f0ee8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8012e10 con 0x7f0ef0155d20 2024-08-15T17:54:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee801e630 con 0x7f0ef0155d20 2024-08-15T17:54:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0149d00 con 0x7f0ef0155d20 2024-08-15T17:54:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee801e9f0 con 0x7f0ef0155d20 2024-08-15T17:54:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef014bb00 con 0x7f0ef0155d20 2024-08-15T17:54:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef014b2e0 con 0x7f0ef0155d20 2024-08-15T17:54:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.114+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0ee8024070 con 0x7f0ef0155d20 2024-08-15T17:54:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.118+0000 7f0ee7fff700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0ed0060860 0x7f0ed0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.118+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ee807f5b0 con 0x7f0ef0155d20 2024-08-15T17:54:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.118+0000 7f0eeffff700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0ed0060860 0x7f0ed0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.118+0000 7f0eeffff700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0ed0060860 0x7f0ed0062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00aebf0 tx=0x7f0ed8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.122+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0ee804fa80 con 0x7f0ef0155d20 2024-08-15T17:54:40.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.286+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef00643a0 con 0x7f0ef0155d20 2024-08-15T17:54:40.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.286+0000 7f0ee7fff700 1 -- 172.21.15.33:0/4245579823 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f0ee80530a0 con 0x7f0ef0155d20 2024-08-15T17:54:40.289 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:40.289 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:54:39.332350+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:40.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0ed0060860 msgr2=0x7f0ed0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0ed0060860 0x7f0ed0062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00aebf0 tx=0x7f0ed8009040 comp rx=0 tx=0).stop 2024-08-15T17:54:40.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 msgr2=0x7f0ef0063290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 0x7f0ef0063290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097c0 tx=0x7f0ee8019000 comp rx=0 tx=0).stop 2024-08-15T17:54:40.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 shutdown_connections 2024-08-15T17:54:40.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0ed0060860 0x7f0ed0062d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef0155d20 0x7f0ef0063290 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ef00b0350 0x7f0ef014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 --2- 172.21.15.33:0/4245579823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ef006e620 0x7f0ef014b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 >> 172.21.15.33:0/4245579823 conn(0x7f0ef00678d0 msgr2=0x7f0ef0152790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:40.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 shutdown_connections 2024-08-15T17:54:40.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.290+0000 7f0ef5068700 1 -- 172.21.15.33:0/4245579823 wait complete. 2024-08-15T17:54:40.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:40.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e7076e700 1 Processor -- start 2024-08-15T17:54:40.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e7076e700 1 -- start start 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e7076e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0e680a9430 0x7f0e680b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e7076e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680b0270 con 0x7f0e6815d540 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e7076e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680af660 con 0x7f0e680af030 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e7076e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680af940 con 0x7f0e680a9430 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6e50a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0e6815d540 0x7f0e6806e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53890/0 (socket says 172.21.15.33:53890) 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6e50a700 1 -- 172.21.15.33:0/1477872630 learned_addr learned my addr 172.21.15.33:0/1477872630 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6ed0b700 1 --2- 172.21.15.33:0/1477872630 >> v2:172.21.15.105:3300/0 conn(0x7f0e680a9430 0x7f0e680b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6d508700 1 -- 172.21.15.33:0/1477872630 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513539652 0 0) 0x7f0e680b0270 con 0x7f0e6815d540 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6d508700 1 -- 172.21.15.33:0/1477872630 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e50003570 con 0x7f0e6815d540 2024-08-15T17:54:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6ed0b700 1 -- 172.21.15.33:0/1477872630 >> v1:172.21.15.105:6789/0 conn(0x7f0e680af030 legacy=0x7f0e680a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6ed0b700 1 -- 172.21.15.33:0/1477872630 >> v1:172.21.15.33:6789/0 conn(0x7f0e6815d540 legacy=0x7f0e6806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6ed0b700 1 -- 172.21.15.33:0/1477872630 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680afc20 con 0x7f0e680a9430 2024-08-15T17:54:40.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6ed0b700 1 --2- 172.21.15.33:0/1477872630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680b0700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009e60 tx=0x7f0e60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e661e22eaf0ef8a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6d508700 1 -- 172.21.15.33:0/1477872630 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x7f0e680a9430 2024-08-15T17:54:40.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6d508700 1 -- 172.21.15.33:0/1477872630 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000bb60 con 0x7f0e680a9430 2024-08-15T17:54:40.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.418+0000 7f0e6d508700 1 -- 172.21.15.33:0/1477872630 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60012430 con 0x7f0e680a9430 2024-08-15T17:54:40.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 -- 172.21.15.33:0/1477872630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 msgr2=0x7f0e680b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 --2- 172.21.15.33:0/1477872630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680b0700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009e60 tx=0x7f0e60009780 comp rx=0 tx=0).stop 2024-08-15T17:54:40.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 -- 172.21.15.33:0/1477872630 shutdown_connections 2024-08-15T17:54:40.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 --2- 172.21.15.33:0/1477872630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680b0700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 -- 172.21.15.33:0/1477872630 >> 172.21.15.33:0/1477872630 conn(0x7f0e68066e00 msgr2=0x7f0e68067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:40.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 -- 172.21.15.33:0/1477872630 shutdown_connections 2024-08-15T17:54:40.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 -- 172.21.15.33:0/1477872630 wait complete. 2024-08-15T17:54:40.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 Processor -- start 2024-08-15T17:54:40.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.422+0000 7f0e7076e700 1 -- start start 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 0x7f0e6806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6815d540 0x7f0e6806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680977c0 con 0x7f0e680af030 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68096bb0 con 0x7f0e680a9430 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68096e90 con 0x7f0e6815d540 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 0x7f0e6806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 0x7f0e6806d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58142/0 (socket says 172.21.15.33:58142) 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6e50a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 -- 172.21.15.33:0/2525218764 learned_addr learned my addr 172.21.15.33:0/2525218764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:40.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6ed0b700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6815d540 0x7f0e6806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 -- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6815d540 msgr2=0x7f0e6806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6815d540 0x7f0e6806dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 -- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 msgr2=0x7f0e680ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680ad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 -- 172.21.15.33:0/2525218764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009a20 con 0x7f0e680af030 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6e50a700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e6dd09700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 0x7f0e6806d750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00c590 tx=0x7f0e5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c011590 con 0x7f0e680af030 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c011710 con 0x7f0e680af030 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68097170 con 0x7f0e680af030 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c011ad0 con 0x7f0e680af030 2024-08-15T17:54:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e68158b40 con 0x7f0e680af030 2024-08-15T17:54:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.426+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e68097970 con 0x7f0e680af030 2024-08-15T17:54:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.430+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0e5c01b3b0 con 0x7f0e680af030 2024-08-15T17:54:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.430+0000 7f0e667fc700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e54060860 0x7f0e54062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.430+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e5c07c090 con 0x7f0e680af030 2024-08-15T17:54:40.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.430+0000 7f0e6e50a700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e54060860 0x7f0e54062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.430+0000 7f0e6e50a700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e54060860 0x7f0e54062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e58007fd0 tx=0x7f0e58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.438+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0e68097970 con 0x7f0e680af030 2024-08-15T17:54:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e68097970 con 0x7f0e680af030 2024-08-15T17:54:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e667fc700 1 -- 172.21.15.33:0/2525218764 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f0e68097970 con 0x7f0e680af030 2024-08-15T17:54:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:40.604 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:54:39.332350+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e54060860 msgr2=0x7f0e54062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e54060860 0x7f0e54062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e58007fd0 tx=0x7f0e58009040 comp rx=0 tx=0).stop 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 msgr2=0x7f0e6806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 0x7f0e6806d750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00c590 tx=0x7f0e5c00c8a0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 shutdown_connections 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e54060860 0x7f0e54062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6815d540 0x7f0e6806dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e680af030 0x7f0e6806d750 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 --2- 172.21.15.33:0/2525218764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e680a9430 0x7f0e680ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 >> 172.21.15.33:0/2525218764 conn(0x7f0e68066e00 msgr2=0x7f0e6815b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 shutdown_connections 2024-08-15T17:54:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.602+0000 7f0e7076e700 1 -- 172.21.15.33:0/2525218764 wait complete. 2024-08-15T17:54:40.618 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-15T17:54:40.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.726+0000 7fece5597700 1 Processor -- start 2024-08-15T17:54:40.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fece5597700 1 -- start start 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fece5597700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fece00cfb00 0x7fece0067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fece5597700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00cf670 con 0x7fece0067030 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fece5597700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00cea60 con 0x7fece0158cc0 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fece5597700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00ced40 con 0x7fece00cfb00 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fece0067030 0x7fece00cb080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53892/0 (socket says 172.21.15.33:53892) 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdffff700 1 -- 172.21.15.33:0/2642354285 learned_addr learned my addr 172.21.15.33:0/2642354285 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:40.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdf7fe700 1 --2- 172.21.15.33:0/2642354285 >> v2:172.21.15.105:3300/0 conn(0x7fece00cfb00 0x7fece0067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdeffd700 1 -- 172.21.15.33:0/2642354285 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953399448 0 0) 0x7fece00cf670 con 0x7fece0067030 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdeffd700 1 -- 172.21.15.33:0/2642354285 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feccc003570 con 0x7fece0067030 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdf7fe700 1 -- 172.21.15.33:0/2642354285 >> v1:172.21.15.105:6789/0 conn(0x7fece0158cc0 legacy=0x7fece01590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdeffd700 1 -- 172.21.15.33:0/2642354285 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812351679 0 0) 0x7fece00cea60 con 0x7fece0158cc0 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdf7fe700 1 -- 172.21.15.33:0/2642354285 >> v1:172.21.15.33:6789/0 conn(0x7fece0067030 legacy=0x7fece00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdf7fe700 1 -- 172.21.15.33:0/2642354285 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00cf020 con 0x7fece00cfb00 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdf7fe700 1 --2- 172.21.15.33:0/2642354285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece0067400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecc80098e0 tx=0x7fecc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68855312700e2e4e server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdeffd700 1 -- 172.21.15.33:0/2642354285 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8011630 con 0x7fece00cfb00 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdeffd700 1 -- 172.21.15.33:0/2642354285 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8011790 con 0x7fece00cfb00 2024-08-15T17:54:40.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.730+0000 7fecdeffd700 1 -- 172.21.15.33:0/2642354285 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8011b10 con 0x7fece00cfb00 2024-08-15T17:54:40.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 -- 172.21.15.33:0/2642354285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 msgr2=0x7fece0067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 --2- 172.21.15.33:0/2642354285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece0067400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecc80098e0 tx=0x7fecc80091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 -- 172.21.15.33:0/2642354285 shutdown_connections 2024-08-15T17:54:40.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 --2- 172.21.15.33:0/2642354285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece0067400 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 -- 172.21.15.33:0/2642354285 >> 172.21.15.33:0/2642354285 conn(0x7fece00d0b50 msgr2=0x7fece00ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:40.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 -- 172.21.15.33:0/2642354285 shutdown_connections 2024-08-15T17:54:40.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 -- 172.21.15.33:0/2642354285 wait complete. 2024-08-15T17:54:40.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 Processor -- start 2024-08-15T17:54:40.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.734+0000 7fece5597700 1 -- start start 2024-08-15T17:54:40.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0067030 0x7fece00c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece00c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 0x7fece015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00b3990 con 0x7fece0158cc0 2024-08-15T17:54:40.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece015c310 con 0x7fece00cfb00 2024-08-15T17:54:40.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c99c0 con 0x7fece0067030 2024-08-15T17:54:40.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 0x7fece015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 0x7fece015b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58154/0 (socket says 172.21.15.33:58154) 2024-08-15T17:54:40.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 -- 172.21.15.33:0/2823508134 learned_addr learned my addr 172.21.15.33:0/2823508134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:40.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fecdffff700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0067030 0x7fece00c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fecdf7fe700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece00c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 -- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0067030 msgr2=0x7fece00c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0067030 0x7fece00c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 -- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 msgr2=0x7fece00c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:40.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece00c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 -- 172.21.15.33:0/2823508134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009420 con 0x7fece0158cc0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece4d96700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 0x7fece015b3b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fecd800c8c0 tx=0x7fecd8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8012630 con 0x7fece0158cc0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8012790 con 0x7fece0158cc0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece015c030 con 0x7fece0158cc0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8012b50 con 0x7fece0158cc0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00c9650 con 0x7fece0158cc0 2024-08-15T17:54:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.738+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00c91d0 con 0x7fece0158cc0 2024-08-15T17:54:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.742+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fecd8003030 con 0x7fece0158cc0 2024-08-15T17:54:40.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.742+0000 7fecd7fff700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fecc0060890 0x7fecc0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:40.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.742+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fecd807cae0 con 0x7fece0158cc0 2024-08-15T17:54:40.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.742+0000 7fecdffff700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fecc0060890 0x7fecc0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.742+0000 7fecdffff700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fecc0060890 0x7fecc0062d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fecd0007fd0 tx=0x7fecd0000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:40.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.750+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fece00c91d0 con 0x7fece0158cc0 2024-08-15T17:54:40.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:40.950+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fece00c91d0 con 0x7fece0158cc0 2024-08-15T17:54:41.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.874+0000 7fecd7fff700 1 -- 172.21.15.33:0/2823508134 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fece00c91d0 con 0x7fece0158cc0 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fecc0060890 msgr2=0x7fecc0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fecc0060890 0x7fecc0062d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fecd0007fd0 tx=0x7fecd0000bc0 comp rx=0 tx=0).stop 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 msgr2=0x7fece015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 0x7fece015b3b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fecd800c8c0 tx=0x7fecd8001630 comp rx=0 tx=0).stop 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 shutdown_connections 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fecc0060890 0x7fecc0062d40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece00cfb00 0x7fece00c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece0158cc0 0x7fece015b3b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 --2- 172.21.15.33:0/2823508134 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0067030 0x7fece00c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 >> 172.21.15.33:0/2823508134 conn(0x7fece00d0b50 msgr2=0x7fece00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 shutdown_connections 2024-08-15T17:54:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:41.878+0000 7fece5597700 1 -- 172.21.15.33:0/2823508134 wait complete. 2024-08-15T17:54:41.894 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-15T17:54:42.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.010+0000 7fdd472f3700 1 Processor -- start 2024-08-15T17:54:42.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.010+0000 7fdd472f3700 1 -- start start 2024-08-15T17:54:42.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.010+0000 7fdd472f3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdd400cbcc0 0x7fdd4015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.010+0000 7fdd472f3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd4015d9f0 0x7fdd400c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.010+0000 7fdd472f3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd400cc350 con 0x7fdd400b0390 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400ca760 con 0x7fdd400cbcc0 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400cd3f0 con 0x7fdd4015d9f0 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdd400cbcc0 0x7fdd4015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdd400cbcc0 0x7fdd4015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58162/0 (socket says 172.21.15.33:58162) 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 -- 172.21.15.33:0/1379148714 learned_addr learned my addr 172.21.15.33:0/1379148714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:42.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd46af2700 1 --2- 172.21.15.33:0/1379148714 >> v2:172.21.15.105:3300/0 conn(0x7fdd4015d9f0 0x7fdd400c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:42.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 -- 172.21.15.33:0/1379148714 >> v2:172.21.15.105:3300/0 conn(0x7fdd4015d9f0 msgr2=0x7fdd400c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:42.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 --2- 172.21.15.33:0/1379148714 >> v2:172.21.15.105:3300/0 conn(0x7fdd4015d9f0 0x7fdd400c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 -- 172.21.15.33:0/1379148714 >> v1:172.21.15.105:6789/0 conn(0x7fdd400b0390 legacy=0x7fdd4015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:42.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 -- 172.21.15.33:0/1379148714 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400cc630 con 0x7fdd400cbcc0 2024-08-15T17:54:42.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd45af0700 1 --2- 172.21.15.33:0/1379148714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd400cbcc0 0x7fdd4015d4b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd400ceff0 tx=0x7fdd30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a1fae1983746f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:42.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd452ef700 1 -- 172.21.15.33:0/1379148714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30009e70 con 0x7fdd400cbcc0 2024-08-15T17:54:42.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd452ef700 1 -- 172.21.15.33:0/1379148714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3000b860 con 0x7fdd400cbcc0 2024-08-15T17:54:42.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd452ef700 1 -- 172.21.15.33:0/1379148714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000bc00 con 0x7fdd400cbcc0 2024-08-15T17:54:42.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- 172.21.15.33:0/1379148714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd400cbcc0 msgr2=0x7fdd4015d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:42.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 --2- 172.21.15.33:0/1379148714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd400cbcc0 0x7fdd4015d4b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd400ceff0 tx=0x7fdd30009250 comp rx=0 tx=0).stop 2024-08-15T17:54:42.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- 172.21.15.33:0/1379148714 shutdown_connections 2024-08-15T17:54:42.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 --2- 172.21.15.33:0/1379148714 >> v2:172.21.15.105:3300/0 conn(0x7fdd4015d9f0 0x7fdd400c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 --2- 172.21.15.33:0/1379148714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd400cbcc0 0x7fdd4015d4b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- 172.21.15.33:0/1379148714 >> 172.21.15.33:0/1379148714 conn(0x7fdd400cdee0 msgr2=0x7fdd400ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:42.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- 172.21.15.33:0/1379148714 shutdown_connections 2024-08-15T17:54:42.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.014+0000 7fdd472f3700 1 -- 172.21.15.33:0/1379148714 wait complete. 2024-08-15T17:54:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.018+0000 7fdd472f3700 1 Processor -- start 2024-08-15T17:54:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.018+0000 7fdd472f3700 1 -- start start 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.018+0000 7fdd472f3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd400b0390 0x7fdd40157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 0x7fdd400b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 0x7fdd4016ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40159910 con 0x7fdd4015d9f0 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4014bd50 con 0x7fdd400cbcc0 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4015a450 con 0x7fdd400b0390 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd46af2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 0x7fdd4016ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 0x7fdd400b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd462f1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd400b0390 0x7fdd40157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 0x7fdd400b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:50300/0 (socket says 172.21.15.33:50300) 2024-08-15T17:54:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd46af2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 0x7fdd4016ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58166/0 (socket says 172.21.15.33:58166) 2024-08-15T17:54:42.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd462f1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd400b0390 0x7fdd40157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:46254/0 (socket says 172.21.15.33:46254) 2024-08-15T17:54:42.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 -- 172.21.15.33:0/2426698980 learned_addr learned my addr 172.21.15.33:0/2426698980 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 -- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd400b0390 msgr2=0x7fdd40157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd400b0390 0x7fdd40157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 -- 172.21.15.33:0/2426698980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 msgr2=0x7fdd4016ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 0x7fdd4016ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 -- 172.21.15.33:0/2426698980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300094f0 con 0x7fdd400cbcc0 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd46af2700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 0x7fdd4016ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd45af0700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 0x7fdd400b3560 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd400c4b50 tx=0x7fdd30017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:42.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000bbe0 con 0x7fdd400cbcc0 2024-08-15T17:54:42.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30000c90 con 0x7fdd400cbcc0 2024-08-15T17:54:42.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30011670 con 0x7fdd400cbcc0 2024-08-15T17:54:42.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd40159b20 con 0x7fdd400cbcc0 2024-08-15T17:54:42.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4015a0e0 con 0x7fdd400cbcc0 2024-08-15T17:54:42.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.022+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd400638f0 con 0x7fdd400cbcc0 2024-08-15T17:54:42.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.026+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdd30011a60 con 0x7fdd400cbcc0 2024-08-15T17:54:42.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.026+0000 7fdd367fc700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdd24060860 0x7fdd24062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:42.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.026+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd3007e140 con 0x7fdd400cbcc0 2024-08-15T17:54:42.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.026+0000 7fdd462f1700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdd24060860 0x7fdd24062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:42.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.026+0000 7fdd462f1700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdd24060860 0x7fdd24062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c003aa0 tx=0x7fdd3c000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.038+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdd3004e4f0 con 0x7fdd400cbcc0 2024-08-15T17:54:42.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.242+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdd4015d650 con 0x7fdd400cbcc0 2024-08-15T17:54:42.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.974+0000 7fdd367fc700 1 -- 172.21.15.33:0/2426698980 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd30051b10 con 0x7fdd400cbcc0 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdd24060860 msgr2=0x7fdd24062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdd24060860 0x7fdd24062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c003aa0 tx=0x7fdd3c000bc0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 msgr2=0x7fdd400b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 0x7fdd400b3560 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd400c4b50 tx=0x7fdd30017000 comp rx=0 tx=0).stop 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 shutdown_connections 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fdd24060860 0x7fdd24062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.978+0000 7fdd472f3700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd400cbcc0 0x7fdd400b3560 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.982+0000 7fdd472f3700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4015d9f0 0x7fdd4016ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.982+0000 7fdd472f3700 1 --2- 172.21.15.33:0/2426698980 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd400b0390 0x7fdd40157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.982+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 >> 172.21.15.33:0/2426698980 conn(0x7fdd400cdee0 msgr2=0x7fdd40155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.982+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 shutdown_connections 2024-08-15T17:54:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:42.982+0000 7fdd472f3700 1 -- 172.21.15.33:0/2426698980 wait complete. 2024-08-15T17:54:43.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 Processor -- start 2024-08-15T17:54:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 -- start start 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d0006e620 0x7f8d000b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b1630 0x7f8d00141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00141a00 con 0x7f8d000b0d20 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d00140b10 con 0x7f8d0006e620 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8d04c3c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00140df0 con 0x7f8d000b1630 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8cff7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8d000b0d20 0x7f8d0006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53904/0 (socket says 172.21.15.33:53904) 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8cff7fe700 1 -- 172.21.15.33:0/1386240859 learned_addr learned my addr 172.21.15.33:0/1386240859 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8cfffff700 1 --2- 172.21.15.33:0/1386240859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b1630 0x7f8d00141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8cfeffd700 1 --2- 172.21.15.33:0/1386240859 >> v2:172.21.15.105:3300/0 conn(0x7f8d0006e620 0x7f8d000b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8cfe7fc700 1 -- 172.21.15.33:0/1386240859 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988217578 0 0) 0x7f8d00141a00 con 0x7f8d000b0d20 2024-08-15T17:54:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.110+0000 7f8cfe7fc700 1 -- 172.21.15.33:0/1386240859 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cec003570 con 0x7f8d000b0d20 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfffff700 1 -- 172.21.15.33:0/1386240859 >> v2:172.21.15.105:3300/0 conn(0x7f8d0006e620 msgr2=0x7f8d000b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfffff700 1 --2- 172.21.15.33:0/1386240859 >> v2:172.21.15.105:3300/0 conn(0x7f8d0006e620 0x7f8d000b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfffff700 1 -- 172.21.15.33:0/1386240859 >> v1:172.21.15.33:6789/0 conn(0x7f8d000b0d20 legacy=0x7f8d0006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfffff700 1 -- 172.21.15.33:0/1386240859 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d001410d0 con 0x7f8d000b1630 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfeffd700 1 --2- 172.21.15.33:0/1386240859 >> v2:172.21.15.105:3300/0 conn(0x7f8d0006e620 0x7f8d000b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfffff700 1 --2- 172.21.15.33:0/1386240859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b1630 0x7f8d00141e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009e60 tx=0x7f8cf8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a5253a65cc1460 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfe7fc700 1 -- 172.21.15.33:0/1386240859 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800e070 con 0x7f8d000b1630 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfe7fc700 1 -- 172.21.15.33:0/1386240859 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800bab0 con 0x7f8d000b1630 2024-08-15T17:54:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8cfe7fc700 1 -- 172.21.15.33:0/1386240859 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800be30 con 0x7f8d000b1630 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 -- 172.21.15.33:0/1386240859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b1630 msgr2=0x7f8d00141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/1386240859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b1630 0x7f8d00141e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009e60 tx=0x7f8cf8009780 comp rx=0 tx=0).stop 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 -- 172.21.15.33:0/1386240859 shutdown_connections 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/1386240859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b1630 0x7f8d00141e90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/1386240859 >> v2:172.21.15.105:3300/0 conn(0x7f8d0006e620 0x7f8d000b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 -- 172.21.15.33:0/1386240859 >> 172.21.15.33:0/1386240859 conn(0x7f8d000678d0 msgr2=0x7f8d00067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:43.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 -- 172.21.15.33:0/1386240859 shutdown_connections 2024-08-15T17:54:43.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.114+0000 7f8d04c3c700 1 -- 172.21.15.33:0/1386240859 wait complete. 2024-08-15T17:54:43.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 Processor -- start 2024-08-15T17:54:43.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 -- start start 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0006e620 0x7f8d0013fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b0d20 0x7f8d000a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 0x7f8d000a8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000a94a0 con 0x7f8d000b1630 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d001400f0 con 0x7f8d0006e620 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8d04c3c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000a7660 con 0x7f8d000b0d20 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8cfffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 0x7f8d000a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8cfffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 0x7f8d000a8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58170/0 (socket says 172.21.15.33:58170) 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8cfffff700 1 -- 172.21.15.33:0/2944162921 learned_addr learned my addr 172.21.15.33:0/2944162921 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8cfeffd700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b0d20 0x7f8d000a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.118+0000 7f8cff7fe700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0006e620 0x7f8d0013fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cfffff700 1 -- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b0d20 msgr2=0x7f8d000a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cfffff700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b0d20 0x7f8d000a7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cfffff700 1 -- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0006e620 msgr2=0x7f8d0013fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cfffff700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0006e620 0x7f8d0013fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cfffff700 1 -- 172.21.15.33:0/2944162921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8009420 con 0x7f8d000b1630 2024-08-15T17:54:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cfffff700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 0x7f8d000a8260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800b610 tx=0x7f8cf8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8012bc0 con 0x7f8d000b1630 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf8021070 con 0x7f8d000b1630 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf8009a20 con 0x7f8d000b1630 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8026430 con 0x7f8d000b1630 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d000a8bf0 con 0x7f8d000b1630 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce40052b0 con 0x7f8d000b1630 2024-08-15T17:54:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8cf8023030 con 0x7f8d000b1630 2024-08-15T17:54:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cf77fe700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ce0060860 0x7f8ce0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.122+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cf807eb70 con 0x7f8d000b1630 2024-08-15T17:54:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.126+0000 7f8cff7fe700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ce0060860 0x7f8ce0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.126+0000 7f8cff7fe700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ce0060860 0x7f8ce0062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0007fd0 tx=0x7f8cf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.130+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8cf804ef20 con 0x7f8d000b1630 2024-08-15T17:54:43.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.330+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce4005ae0 con 0x7f8d000b1630 2024-08-15T17:54:43.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8cf77fe700 1 -- 172.21.15.33:0/2944162921 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f8cf8052540 con 0x7f8d000b1630 2024-08-15T17:54:43.335 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:43.335 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:39.333104+0000","modified":"2024-08-15T17:54:42.968502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5002":{"gid":5002,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2964556950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2964556950},{"type":"v1","addr":"172.21.15.105:6837","nonce":2964556950}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-15T17:54:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ce0060860 msgr2=0x7f8ce0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ce0060860 0x7f8ce0062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0007fd0 tx=0x7f8cf0009040 comp rx=0 tx=0).stop 2024-08-15T17:54:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 msgr2=0x7f8d000a8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 0x7f8d000a8260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800b610 tx=0x7f8cf8019000 comp rx=0 tx=0).stop 2024-08-15T17:54:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 shutdown_connections 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8ce0060860 0x7f8ce0062d10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d000b1630 0x7f8d000a8260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d000b0d20 0x7f8d000a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 --2- 172.21.15.33:0/2944162921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d0006e620 0x7f8d0013fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 >> 172.21.15.33:0/2944162921 conn(0x7f8d000678d0 msgr2=0x7f8d0015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 shutdown_connections 2024-08-15T17:54:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.334+0000 7f8d04c3c700 1 -- 172.21.15.33:0/2944162921 wait complete. 2024-08-15T17:54:43.339 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-08-15T17:54:43.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:54:43.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4030c89700 1 Processor -- start 2024-08-15T17:54:43.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4030c89700 1 -- start start 2024-08-15T17:54:43.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4030c89700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f402c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4030c89700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402c0b3800 con 0x7f402c0cd760 2024-08-15T17:54:43.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4030c89700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402c0b3ae0 con 0x7f402c0b3360 2024-08-15T17:54:43.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4030c89700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c068f10 con 0x7f402c15a5b0 2024-08-15T17:54:43.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402a59c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f402c0cd760 0x7f402c0aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53910/0 (socket says 172.21.15.33:53910) 2024-08-15T17:54:43.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402a59c700 1 -- 172.21.15.33:0/175082780 learned_addr learned my addr 172.21.15.33:0/175082780 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947140311 0 0) 0x7f402c0b3800 con 0x7f402c0cd760 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4029d9b700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f402c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4014003570 con 0x7f402c0cd760 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995701455 0 0) 0x7f402c0b3ae0 con 0x7f402c0b3360 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f402c0b3800 con 0x7f402c0b3360 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 745410951 0 0) 0x7f4014003570 con 0x7f402c0cd760 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 msgr2=0x7f402c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f402c0b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 >> v1:172.21.15.105:6789/0 conn(0x7f402c0b3360 legacy=0x7f402c0b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0b3dc0 con 0x7f402c0cd760 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f40240017f0 con 0x7f402c0cd760 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 >> v1:172.21.15.33:6789/0 conn(0x7f402c0cd760 legacy=0x7f402c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4014003c20 0x7f4014004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f4014004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4014004d50 0x7f40140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c068f10 con 0x7f4014004d50 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401400bb40 con 0x7f4014003c20 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401400bd00 con 0x7f402c15a5b0 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f4029d9b700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f4014004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402a59c700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4014003c20 0x7f4014004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.454+0000 7f402ad9d700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4014004d50 0x7f40140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4029d9b700 1 -- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4014003c20 msgr2=0x7f4014004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4029d9b700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4014003c20 0x7f4014004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4029d9b700 1 -- 172.21.15.33:0/175082780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4014004d50 msgr2=0x7f40140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4029d9b700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4014004d50 0x7f40140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4029d9b700 1 -- 172.21.15.33:0/175082780 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014003570 con 0x7f402c15a5b0 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f402ad9d700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4014004d50 0x7f40140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4029d9b700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f4014004810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4020009c00 tx=0x7f40200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e777c1fb34a417 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000e710 con 0x7f402c15a5b0 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402000e870 con 0x7f402c15a5b0 2024-08-15T17:54:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f402959a700 1 -- 172.21.15.33:0/175082780 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000ec30 con 0x7f402c15a5b0 2024-08-15T17:54:43.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 -- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 msgr2=0x7f4014004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 --2- 172.21.15.33:0/175082780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c15a5b0 0x7f4014004810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4020009c00 tx=0x7f40200091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f402ad9d700 1 -- 172.21.15.33:0/175082780 reap_dead start 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 -- 172.21.15.33:0/175082780 shutdown_connections 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 -- 172.21.15.33:0/175082780 >> 172.21.15.33:0/175082780 conn(0x7f402c0ce050 msgr2=0x7f402c0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 -- 172.21.15.33:0/175082780 shutdown_connections 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 -- 172.21.15.33:0/175082780 wait complete. 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.458+0000 7f4030c89700 1 Processor -- start 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- start start 2024-08-15T17:54:43.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402c168ec0 0x7f402c16a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 0x7f402c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c154620 0x7f402c0af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c152f80 con 0x7f402c169290 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c152c50 con 0x7f402c168ec0 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c16a550 con 0x7f402c154620 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 0x7f402c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 0x7f402c153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58194/0 (socket says 172.21.15.33:58194) 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 -- 172.21.15.33:0/2347346758 learned_addr learned my addr 172.21.15.33:0/2347346758 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f402a59c700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402c168ec0 0x7f402c16a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f402ad9d700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c154620 0x7f402c0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 -- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c154620 msgr2=0x7f402c0af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c154620 0x7f402c0af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 -- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402c168ec0 msgr2=0x7f402c16a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402c168ec0 0x7f402c16a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 -- 172.21.15.33:0/2347346758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0c7d40 con 0x7f402c169290 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4029d9b700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 0x7f402c153410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f402000e4b0 tx=0x7f402001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020022070 con 0x7f402c169290 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402000e9e0 con 0x7f402c169290 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c0c8020 con 0x7f402c169290 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020027470 con 0x7f402c169290 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c153950 con 0x7f402c169290 2024-08-15T17:54:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.462+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c1530f0 con 0x7f402c169290 2024-08-15T17:54:43.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.466+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4020027860 con 0x7f402c169290 2024-08-15T17:54:43.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.466+0000 7f401a7fc700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f400c060860 0x7f400c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.466+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f402007e7a0 con 0x7f402c169290 2024-08-15T17:54:43.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.466+0000 7f402a59c700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f400c060860 0x7f400c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.466+0000 7f402a59c700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f400c060860 0x7f400c062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f402c0b0e80 tx=0x7f4024006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.474+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f402004ec00 con 0x7f402c169290 2024-08-15T17:54:43.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.642+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f402c0645c0 con 0x7f402c169290 2024-08-15T17:54:43.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.642+0000 7f401a7fc700 1 -- 172.21.15.33:0/2347346758 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4020052220 con 0x7f402c169290 2024-08-15T17:54:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:43.644 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:54:40.954917+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f400c060860 msgr2=0x7f400c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f400c060860 0x7f400c062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f402c0b0e80 tx=0x7f4024006040 comp rx=0 tx=0).stop 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 msgr2=0x7f402c153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 0x7f402c153410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f402000e4b0 tx=0x7f402001a000 comp rx=0 tx=0).stop 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 shutdown_connections 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f400c060860 0x7f400c062d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f402c154620 0x7f402c0af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f402c169290 0x7f402c153410 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 --2- 172.21.15.33:0/2347346758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402c168ec0 0x7f402c16a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 >> 172.21.15.33:0/2347346758 conn(0x7f402c0ce050 msgr2=0x7f402c1501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 shutdown_connections 2024-08-15T17:54:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.646+0000 7f4030c89700 1 -- 172.21.15.33:0/2347346758 wait complete. 2024-08-15T17:54:43.665 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-15T17:54:43.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:54:43.672 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-08-15T17:54:43.668+0000 7f965158f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-15T17:54:43.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 Processor -- start 2024-08-15T17:54:43.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 -- start start 2024-08-15T17:54:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8a7815aa30 0x7f8a7815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a780b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7815a820 con 0x7f8a780aac50 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7815bc90 con 0x7f8a7815aa30 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.766+0000 7f8a7d88b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780b4490 con 0x7f8a780b3b30 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8a7815aa30 0x7f8a7815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8a7815aa30 0x7f8a7815a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58210/0 (socket says 172.21.15.33:58210) 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 -- 172.21.15.33:0/2714600062 learned_addr learned my addr 172.21.15.33:0/2714600062 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a777fe700 1 --2- 172.21.15.33:0/2714600062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a780b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 -- 172.21.15.33:0/2714600062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 msgr2=0x7f8a780b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 --2- 172.21.15.33:0/2714600062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a780b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 -- 172.21.15.33:0/2714600062 >> v1:172.21.15.105:6789/0 conn(0x7f8a780aac50 legacy=0x7f8a781574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 -- 172.21.15.33:0/2714600062 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7815b010 con 0x7f8a7815aa30 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a75ffb700 1 -- 172.21.15.33:0/2714600062 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689074039 0 0) 0x7f8a68001160 con 0x7f8a780aac50 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a767fc700 1 --2- 172.21.15.33:0/2714600062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7815a2e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0099b0 tx=0x7f8a6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b10cf3eace9e519 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a75ffb700 1 -- 172.21.15.33:0/2714600062 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c009ea0 con 0x7f8a7815aa30 2024-08-15T17:54:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a75ffb700 1 -- 172.21.15.33:0/2714600062 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00b860 con 0x7f8a7815aa30 2024-08-15T17:54:43.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a75ffb700 1 -- 172.21.15.33:0/2714600062 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00bc00 con 0x7f8a7815aa30 2024-08-15T17:54:43.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2714600062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 msgr2=0x7f8a7815a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2714600062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7815a2e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0099b0 tx=0x7f8a6c009250 comp rx=0 tx=0).stop 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2714600062 shutdown_connections 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2714600062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a780b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2714600062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7815a2e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2714600062 >> 172.21.15.33:0/2714600062 conn(0x7f8a780994d0 msgr2=0x7f8a780675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2714600062 shutdown_connections 2024-08-15T17:54:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.770+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2714600062 wait complete. 2024-08-15T17:54:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 Processor -- start 2024-08-15T17:54:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 -- start start 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a780aac50 0x7f8a7809bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a7809c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7816cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7809b060 con 0x7f8a7815aa30 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7809c7f0 con 0x7f8a780aac50 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7809cad0 con 0x7f8a780b3b30 2024-08-15T17:54:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7816cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7816cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58226/0 (socket says 172.21.15.33:58226) 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 -- 172.21.15.33:0/2505058211 learned_addr learned my addr 172.21.15.33:0/2505058211 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a767fc700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a7809c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a76ffd700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a780aac50 0x7f8a7809bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 -- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 msgr2=0x7f8a7809c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a7809c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 -- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a780aac50 msgr2=0x7f8a7809bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a780aac50 0x7f8a7809bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 -- 172.21.15.33:0/2505058211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0094f0 con 0x7f8a7815aa30 2024-08-15T17:54:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a777fe700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7816cc10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009e90 tx=0x7f8a7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000cb70 con 0x7f8a7815aa30 2024-08-15T17:54:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000f040 con 0x7f8a7815aa30 2024-08-15T17:54:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70014480 con 0x7f8a7815aa30 2024-08-15T17:54:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7809cdb0 con 0x7f8a7815aa30 2024-08-15T17:54:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.774+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7816d150 con 0x7f8a7815aa30 2024-08-15T17:54:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.778+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a780645c0 con 0x7f8a7815aa30 2024-08-15T17:54:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.778+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8a70014830 con 0x7f8a7815aa30 2024-08-15T17:54:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.778+0000 7f8a5effd700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8a64060860 0x7f8a64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.778+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a7007d530 con 0x7f8a7815aa30 2024-08-15T17:54:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.778+0000 7f8a76ffd700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8a64060860 0x7f8a64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.778+0000 7f8a76ffd700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8a64060860 0x7f8a64062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a680013c0 tx=0x7f8a68007b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:43.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.786+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8a7004d980 con 0x7f8a7815aa30 2024-08-15T17:54:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.946+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a7809d230 con 0x7f8a64060860 2024-08-15T17:54:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.966+0000 7f8a5effd700 1 -- 172.21.15.33:0/2505058211 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274183 (secure 0 0 0) 0x7f8a7809d230 con 0x7f8a64060860 2024-08-15T17:54:43.972 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:43.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8a64060860 msgr2=0x7f8a64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8a64060860 0x7f8a64062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a680013c0 tx=0x7f8a68007b90 comp rx=0 tx=0).stop 2024-08-15T17:54:43.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 msgr2=0x7f8a7816cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7816cc10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009e90 tx=0x7f8a7000b040 comp rx=0 tx=0).stop 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 shutdown_connections 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8a64060860 0x7f8a64062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a7815aa30 0x7f8a7816cc10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a780b3b30 0x7f8a7809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 --2- 172.21.15.33:0/2505058211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a780aac50 0x7f8a7809bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 >> 172.21.15.33:0/2505058211 conn(0x7f8a780994d0 msgr2=0x7f8a780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:43.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 shutdown_connections 2024-08-15T17:54:43.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:43.970+0000 7f8a7d88b700 1 -- 172.21.15.33:0/2505058211 wait complete. 2024-08-15T17:54:43.979 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:54:43.989 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-08-15T17:54:42.255430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591942,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2391072,"kb_used_data":3844,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752583648,"statfs":{"total":773094113280,"available":770645655552,"internally_reserved":0,"allocated":3936256,"data_stored":2214031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1574,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.304438"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.976600+0000","last_change":"2024-08-15T17:54:39.976600+0000","last_active":"2024-08-15T17:54:39.976600+0000","last_peered":"2024-08-15T17:54:39.976600+0000","last_clean":"2024-08-15T17:54:39.976600+0000","last_became_active":"2024-08-15T17:54:39.976328+0000","last_became_peered":"2024-08-15T17:54:39.976328+0000","last_unstale":"2024-08-15T17:54:39.976600+0000","last_undegraded":"2024-08-15T17:54:39.976600+0000","last_fullsized":"2024-08-15T17:54:39.976600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:32:16.827557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986368+0000","last_change":"2024-08-15T17:54:39.986368+0000","last_active":"2024-08-15T17:54:39.986368+0000","last_peered":"2024-08-15T17:54:39.986368+0000","last_clean":"2024-08-15T17:54:39.986368+0000","last_became_active":"2024-08-15T17:54:39.983917+0000","last_became_peered":"2024-08-15T17:54:39.983917+0000","last_unstale":"2024-08-15T17:54:39.986368+0000","last_undegraded":"2024-08-15T17:54:39.986368+0000","last_fullsized":"2024-08-15T17:54:39.986368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:18:29.468896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991329+0000","last_change":"2024-08-15T17:54:39.986958+0000","last_active":"2024-08-15T17:54:39.991329+0000","last_peered":"2024-08-15T17:54:39.991329+0000","last_clean":"2024-08-15T17:54:39.991329+0000","last_became_active":"2024-08-15T17:54:39.984118+0000","last_became_peered":"2024-08-15T17:54:39.984118+0000","last_unstale":"2024-08-15T17:54:39.991329+0000","last_undegraded":"2024-08-15T17:54:39.991329+0000","last_fullsized":"2024-08-15T17:54:39.991329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:45:19.279041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983721+0000","last_change":"2024-08-15T17:54:39.983721+0000","last_active":"2024-08-15T17:54:39.983721+0000","last_peered":"2024-08-15T17:54:39.983721+0000","last_clean":"2024-08-15T17:54:39.983721+0000","last_became_active":"2024-08-15T17:54:39.983435+0000","last_became_peered":"2024-08-15T17:54:39.983435+0000","last_unstale":"2024-08-15T17:54:39.983721+0000","last_undegraded":"2024-08-15T17:54:39.983721+0000","last_fullsized":"2024-08-15T17:54:39.983721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:25:53.380656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991914+0000","last_change":"2024-08-15T17:54:39.985338+0000","last_active":"2024-08-15T17:54:39.991914+0000","last_peered":"2024-08-15T17:54:39.991914+0000","last_clean":"2024-08-15T17:54:39.991914+0000","last_became_active":"2024-08-15T17:54:39.985026+0000","last_became_peered":"2024-08-15T17:54:39.985026+0000","last_unstale":"2024-08-15T17:54:39.991914+0000","last_undegraded":"2024-08-15T17:54:39.991914+0000","last_fullsized":"2024-08-15T17:54:39.991914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:10:05.432359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977870+0000","last_change":"2024-08-15T17:54:39.977870+0000","last_active":"2024-08-15T17:54:39.977870+0000","last_peered":"2024-08-15T17:54:39.977870+0000","last_clean":"2024-08-15T17:54:39.977870+0000","last_became_active":"2024-08-15T17:54:39.977565+0000","last_became_peered":"2024-08-15T17:54:39.977565+0000","last_unstale":"2024-08-15T17:54:39.977870+0000","last_undegraded":"2024-08-15T17:54:39.977870+0000","last_fullsized":"2024-08-15T17:54:39.977870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:22:46.358665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983608+0000","last_change":"2024-08-15T17:54:39.978002+0000","last_active":"2024-08-15T17:54:39.983608+0000","last_peered":"2024-08-15T17:54:39.983608+0000","last_clean":"2024-08-15T17:54:39.983608+0000","last_became_active":"2024-08-15T17:54:39.977727+0000","last_became_peered":"2024-08-15T17:54:39.977727+0000","last_unstale":"2024-08-15T17:54:39.983608+0000","last_undegraded":"2024-08-15T17:54:39.983608+0000","last_fullsized":"2024-08-15T17:54:39.983608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:04:34.281769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987044+0000","last_change":"2024-08-15T17:54:39.987044+0000","last_active":"2024-08-15T17:54:39.987044+0000","last_peered":"2024-08-15T17:54:39.987044+0000","last_clean":"2024-08-15T17:54:39.987044+0000","last_became_active":"2024-08-15T17:54:39.986723+0000","last_became_peered":"2024-08-15T17:54:39.986723+0000","last_unstale":"2024-08-15T17:54:39.987044+0000","last_undegraded":"2024-08-15T17:54:39.987044+0000","last_fullsized":"2024-08-15T17:54:39.987044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:10:05.432359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987165+0000","last_change":"2024-08-15T17:54:39.982904+0000","last_active":"2024-08-15T17:54:39.987165+0000","last_peered":"2024-08-15T17:54:39.987165+0000","last_clean":"2024-08-15T17:54:39.987165+0000","last_became_active":"2024-08-15T17:54:39.982542+0000","last_became_peered":"2024-08-15T17:54:39.982542+0000","last_unstale":"2024-08-15T17:54:39.987165+0000","last_undegraded":"2024-08-15T17:54:39.987165+0000","last_fullsized":"2024-08-15T17:54:39.987165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:27:11.356760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.974167+0000","last_change":"2024-08-15T17:54:39.971594+0000","last_active":"2024-08-15T17:54:39.974167+0000","last_peered":"2024-08-15T17:54:39.974167+0000","last_clean":"2024-08-15T17:54:39.974167+0000","last_became_active":"2024-08-15T17:54:39.971181+0000","last_became_peered":"2024-08-15T17:54:39.971181+0000","last_unstale":"2024-08-15T17:54:39.974167+0000","last_undegraded":"2024-08-15T17:54:39.974167+0000","last_fullsized":"2024-08-15T17:54:39.974167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:10:00.947814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.982178+0000","last_change":"2024-08-15T17:54:39.978239+0000","last_active":"2024-08-15T17:54:39.982178+0000","last_peered":"2024-08-15T17:54:39.982178+0000","last_clean":"2024-08-15T17:54:39.982178+0000","last_became_active":"2024-08-15T17:54:39.977956+0000","last_became_peered":"2024-08-15T17:54:39.977956+0000","last_unstale":"2024-08-15T17:54:39.982178+0000","last_undegraded":"2024-08-15T17:54:39.982178+0000","last_fullsized":"2024-08-15T17:54:39.982178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:33:53.146735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979773+0000","last_change":"2024-08-15T17:54:39.977561+0000","last_active":"2024-08-15T17:54:39.979773+0000","last_peered":"2024-08-15T17:54:39.979773+0000","last_clean":"2024-08-15T17:54:39.979773+0000","last_became_active":"2024-08-15T17:54:39.977274+0000","last_became_peered":"2024-08-15T17:54:39.977274+0000","last_unstale":"2024-08-15T17:54:39.979773+0000","last_undegraded":"2024-08-15T17:54:39.979773+0000","last_fullsized":"2024-08-15T17:54:39.979773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:22:46.358665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987214+0000","last_change":"2024-08-15T17:54:39.981893+0000","last_active":"2024-08-15T17:54:39.987214+0000","last_peered":"2024-08-15T17:54:39.987214+0000","last_clean":"2024-08-15T17:54:39.987214+0000","last_became_active":"2024-08-15T17:54:39.980925+0000","last_became_peered":"2024-08-15T17:54:39.980925+0000","last_unstale":"2024-08-15T17:54:39.987214+0000","last_undegraded":"2024-08-15T17:54:39.987214+0000","last_fullsized":"2024-08-15T17:54:39.987214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:06:14.053471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986671+0000","last_change":"2024-08-15T17:54:39.981514+0000","last_active":"2024-08-15T17:54:39.986671+0000","last_peered":"2024-08-15T17:54:39.986671+0000","last_clean":"2024-08-15T17:54:39.986671+0000","last_became_active":"2024-08-15T17:54:39.981150+0000","last_became_peered":"2024-08-15T17:54:39.981150+0000","last_unstale":"2024-08-15T17:54:39.986671+0000","last_undegraded":"2024-08-15T17:54:39.986671+0000","last_fullsized":"2024-08-15T17:54:39.986671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:10:00.044550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983783+0000","last_change":"2024-08-15T17:54:39.980221+0000","last_active":"2024-08-15T17:54:39.983783+0000","last_peered":"2024-08-15T17:54:39.983783+0000","last_clean":"2024-08-15T17:54:39.983783+0000","last_became_active":"2024-08-15T17:54:39.979839+0000","last_became_peered":"2024-08-15T17:54:39.979839+0000","last_unstale":"2024-08-15T17:54:39.983783+0000","last_undegraded":"2024-08-15T17:54:39.983783+0000","last_fullsized":"2024-08-15T17:54:39.983783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:53:08.266357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983754+0000","last_change":"2024-08-15T17:54:39.979509+0000","last_active":"2024-08-15T17:54:39.983754+0000","last_peered":"2024-08-15T17:54:39.983754+0000","last_clean":"2024-08-15T17:54:39.983754+0000","last_became_active":"2024-08-15T17:54:39.979228+0000","last_became_peered":"2024-08-15T17:54:39.979228+0000","last_unstale":"2024-08-15T17:54:39.983754+0000","last_undegraded":"2024-08-15T17:54:39.983754+0000","last_fullsized":"2024-08-15T17:54:39.983754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:14:07.034482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.974053+0000","last_change":"2024-08-15T17:54:39.974053+0000","last_active":"2024-08-15T17:54:39.974053+0000","last_peered":"2024-08-15T17:54:39.974053+0000","last_clean":"2024-08-15T17:54:39.974053+0000","last_became_active":"2024-08-15T17:54:39.973695+0000","last_became_peered":"2024-08-15T17:54:39.973695+0000","last_unstale":"2024-08-15T17:54:39.974053+0000","last_undegraded":"2024-08-15T17:54:39.974053+0000","last_fullsized":"2024-08-15T17:54:39.974053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:00:36.657366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.982623+0000","last_change":"2024-08-15T17:54:39.979412+0000","last_active":"2024-08-15T17:54:39.982623+0000","last_peered":"2024-08-15T17:54:39.982623+0000","last_clean":"2024-08-15T17:54:39.982623+0000","last_became_active":"2024-08-15T17:54:39.978805+0000","last_became_peered":"2024-08-15T17:54:39.978805+0000","last_unstale":"2024-08-15T17:54:39.982623+0000","last_undegraded":"2024-08-15T17:54:39.982623+0000","last_fullsized":"2024-08-15T17:54:39.982623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:34:04.520899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998552+0000","last_change":"2024-08-15T17:54:38.987507+0000","last_active":"2024-08-15T17:54:39.998552+0000","last_peered":"2024-08-15T17:54:39.998552+0000","last_clean":"2024-08-15T17:54:39.998552+0000","last_became_active":"2024-08-15T17:54:38.987014+0000","last_became_peered":"2024-08-15T17:54:38.987014+0000","last_unstale":"2024-08-15T17:54:39.998552+0000","last_undegraded":"2024-08-15T17:54:39.998552+0000","last_fullsized":"2024-08-15T17:54:39.998552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:21:40.732997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.997306+0000","last_change":"2024-08-15T17:54:38.983015+0000","last_active":"2024-08-15T17:54:39.997306+0000","last_peered":"2024-08-15T17:54:39.997306+0000","last_clean":"2024-08-15T17:54:39.997306+0000","last_became_active":"2024-08-15T17:54:38.982727+0000","last_became_peered":"2024-08-15T17:54:38.982727+0000","last_unstale":"2024-08-15T17:54:39.997306+0000","last_undegraded":"2024-08-15T17:54:39.997306+0000","last_fullsized":"2024-08-15T17:54:39.997306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:41:12.145176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.988841+0000","last_change":"2024-08-15T17:54:39.977658+0000","last_active":"2024-08-15T17:54:39.988841+0000","last_peered":"2024-08-15T17:54:39.988841+0000","last_clean":"2024-08-15T17:54:39.988841+0000","last_became_active":"2024-08-15T17:54:39.977364+0000","last_became_peered":"2024-08-15T17:54:39.977364+0000","last_unstale":"2024-08-15T17:54:39.988841+0000","last_undegraded":"2024-08-15T17:54:39.988841+0000","last_fullsized":"2024-08-15T17:54:39.988841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:56:13.007810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:40.000048+0000","last_change":"2024-08-15T17:54:38.989027+0000","last_active":"2024-08-15T17:54:40.000048+0000","last_peered":"2024-08-15T17:54:40.000048+0000","last_clean":"2024-08-15T17:54:40.000048+0000","last_became_active":"2024-08-15T17:54:38.988732+0000","last_became_peered":"2024-08-15T17:54:38.988732+0000","last_unstale":"2024-08-15T17:54:40.000048+0000","last_undegraded":"2024-08-15T17:54:40.000048+0000","last_fullsized":"2024-08-15T17:54:40.000048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:43:44.789274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.980132+0000","last_change":"2024-08-15T17:54:39.980132+0000","last_active":"2024-08-15T17:54:39.980132+0000","last_peered":"2024-08-15T17:54:39.980132+0000","last_clean":"2024-08-15T17:54:39.980132+0000","last_became_active":"2024-08-15T17:54:39.978393+0000","last_became_peered":"2024-08-15T17:54:39.978393+0000","last_unstale":"2024-08-15T17:54:39.980132+0000","last_undegraded":"2024-08-15T17:54:39.980132+0000","last_fullsized":"2024-08-15T17:54:39.980132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:00.120025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978517+0000","last_change":"2024-08-15T17:54:39.978517+0000","last_active":"2024-08-15T17:54:39.978517+0000","last_peered":"2024-08-15T17:54:39.978517+0000","last_clean":"2024-08-15T17:54:39.978517+0000","last_became_active":"2024-08-15T17:54:39.978216+0000","last_became_peered":"2024-08-15T17:54:39.978216+0000","last_unstale":"2024-08-15T17:54:39.978517+0000","last_undegraded":"2024-08-15T17:54:39.978517+0000","last_fullsized":"2024-08-15T17:54:39.978517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:20:14.069673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.960287+0000","last_change":"2024-08-15T17:54:38.988881+0000","last_active":"2024-08-15T17:54:39.960287+0000","last_peered":"2024-08-15T17:54:39.960287+0000","last_clean":"2024-08-15T17:54:39.960287+0000","last_became_active":"2024-08-15T17:54:38.988600+0000","last_became_peered":"2024-08-15T17:54:38.988600+0000","last_unstale":"2024-08-15T17:54:39.960287+0000","last_undegraded":"2024-08-15T17:54:39.960287+0000","last_fullsized":"2024-08-15T17:54:39.960287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:18.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983326+0000","last_change":"2024-08-15T17:54:39.978597+0000","last_active":"2024-08-15T17:54:39.983326+0000","last_peered":"2024-08-15T17:54:39.983326+0000","last_clean":"2024-08-15T17:54:39.983326+0000","last_became_active":"2024-08-15T17:54:39.978307+0000","last_became_peered":"2024-08-15T17:54:39.978307+0000","last_unstale":"2024-08-15T17:54:39.983326+0000","last_undegraded":"2024-08-15T17:54:39.983326+0000","last_fullsized":"2024-08-15T17:54:39.983326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:57:02.382698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.988196+0000","last_change":"2024-08-15T17:54:38.983736+0000","last_active":"2024-08-15T17:54:38.988196+0000","last_peered":"2024-08-15T17:54:38.988196+0000","last_clean":"2024-08-15T17:54:38.988196+0000","last_became_active":"2024-08-15T17:54:38.982490+0000","last_became_peered":"2024-08-15T17:54:38.982490+0000","last_unstale":"2024-08-15T17:54:38.988196+0000","last_undegraded":"2024-08-15T17:54:38.988196+0000","last_fullsized":"2024-08-15T17:54:38.988196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:12:50.068074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.981501+0000","last_change":"2024-08-15T17:54:39.977385+0000","last_active":"2024-08-15T17:54:39.981501+0000","last_peered":"2024-08-15T17:54:39.981501+0000","last_clean":"2024-08-15T17:54:39.981501+0000","last_became_active":"2024-08-15T17:54:39.977071+0000","last_became_peered":"2024-08-15T17:54:39.977071+0000","last_unstale":"2024-08-15T17:54:39.981501+0000","last_undegraded":"2024-08-15T17:54:39.981501+0000","last_fullsized":"2024-08-15T17:54:39.981501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:14:16.659953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.988220+0000","last_change":"2024-08-15T17:54:38.983481+0000","last_active":"2024-08-15T17:54:38.988220+0000","last_peered":"2024-08-15T17:54:38.988220+0000","last_clean":"2024-08-15T17:54:38.988220+0000","last_became_active":"2024-08-15T17:54:38.982658+0000","last_became_peered":"2024-08-15T17:54:38.982658+0000","last_unstale":"2024-08-15T17:54:38.988220+0000","last_undegraded":"2024-08-15T17:54:38.988220+0000","last_fullsized":"2024-08-15T17:54:38.988220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:23:24.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.990867+0000","last_change":"2024-08-15T17:54:39.984607+0000","last_active":"2024-08-15T17:54:39.990867+0000","last_peered":"2024-08-15T17:54:39.990867+0000","last_clean":"2024-08-15T17:54:39.990867+0000","last_became_active":"2024-08-15T17:54:39.984313+0000","last_became_peered":"2024-08-15T17:54:39.984313+0000","last_unstale":"2024-08-15T17:54:39.990867+0000","last_undegraded":"2024-08-15T17:54:39.990867+0000","last_fullsized":"2024-08-15T17:54:39.990867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:36:13.592983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.999930+0000","last_change":"2024-08-15T17:54:38.990354+0000","last_active":"2024-08-15T17:54:39.999930+0000","last_peered":"2024-08-15T17:54:39.999930+0000","last_clean":"2024-08-15T17:54:39.999930+0000","last_became_active":"2024-08-15T17:54:38.990157+0000","last_became_peered":"2024-08-15T17:54:38.990157+0000","last_unstale":"2024-08-15T17:54:39.999930+0000","last_undegraded":"2024-08-15T17:54:39.999930+0000","last_fullsized":"2024-08-15T17:54:39.999930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:10:08.460243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986467+0000","last_change":"2024-08-15T17:54:39.980653+0000","last_active":"2024-08-15T17:54:39.986467+0000","last_peered":"2024-08-15T17:54:39.986467+0000","last_clean":"2024-08-15T17:54:39.986467+0000","last_became_active":"2024-08-15T17:54:39.980247+0000","last_became_peered":"2024-08-15T17:54:39.980247+0000","last_unstale":"2024-08-15T17:54:39.986467+0000","last_undegraded":"2024-08-15T17:54:39.986467+0000","last_fullsized":"2024-08-15T17:54:39.986467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:51:19.148489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991373+0000","last_change":"2024-08-15T17:54:39.984953+0000","last_active":"2024-08-15T17:54:39.991373+0000","last_peered":"2024-08-15T17:54:39.991373+0000","last_clean":"2024-08-15T17:54:39.991373+0000","last_became_active":"2024-08-15T17:54:39.984508+0000","last_became_peered":"2024-08-15T17:54:39.984508+0000","last_unstale":"2024-08-15T17:54:39.991373+0000","last_undegraded":"2024-08-15T17:54:39.991373+0000","last_fullsized":"2024-08-15T17:54:39.991373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:39:20.992056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.964030+0000","last_change":"2024-08-15T17:54:38.987274+0000","last_active":"2024-08-15T17:54:39.964030+0000","last_peered":"2024-08-15T17:54:39.964030+0000","last_clean":"2024-08-15T17:54:39.964030+0000","last_became_active":"2024-08-15T17:54:38.987005+0000","last_became_peered":"2024-08-15T17:54:38.987005+0000","last_unstale":"2024-08-15T17:54:39.964030+0000","last_undegraded":"2024-08-15T17:54:39.964030+0000","last_fullsized":"2024-08-15T17:54:39.964030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:42:33.734806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.964232+0000","last_change":"2024-08-15T17:54:38.988042+0000","last_active":"2024-08-15T17:54:39.964232+0000","last_peered":"2024-08-15T17:54:39.964232+0000","last_clean":"2024-08-15T17:54:39.964232+0000","last_became_active":"2024-08-15T17:54:38.987740+0000","last_became_peered":"2024-08-15T17:54:38.987740+0000","last_unstale":"2024-08-15T17:54:39.964232+0000","last_undegraded":"2024-08-15T17:54:39.964232+0000","last_fullsized":"2024-08-15T17:54:39.964232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:59:03.114891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998717+0000","last_change":"2024-08-15T17:54:38.986325+0000","last_active":"2024-08-15T17:54:39.998717+0000","last_peered":"2024-08-15T17:54:39.998717+0000","last_clean":"2024-08-15T17:54:39.998717+0000","last_became_active":"2024-08-15T17:54:38.986071+0000","last_became_peered":"2024-08-15T17:54:38.986071+0000","last_unstale":"2024-08-15T17:54:39.998717+0000","last_undegraded":"2024-08-15T17:54:39.998717+0000","last_fullsized":"2024-08-15T17:54:39.998717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:14.112077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.994054+0000","last_change":"2024-08-15T17:54:38.989354+0000","last_active":"2024-08-15T17:54:39.994054+0000","last_peered":"2024-08-15T17:54:39.994054+0000","last_clean":"2024-08-15T17:54:39.994054+0000","last_became_active":"2024-08-15T17:54:38.989075+0000","last_became_peered":"2024-08-15T17:54:38.989075+0000","last_unstale":"2024-08-15T17:54:39.994054+0000","last_undegraded":"2024-08-15T17:54:39.994054+0000","last_fullsized":"2024-08-15T17:54:39.994054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:36:38.059749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977253+0000","last_change":"2024-08-15T17:54:39.977253+0000","last_active":"2024-08-15T17:54:39.977253+0000","last_peered":"2024-08-15T17:54:39.977253+0000","last_clean":"2024-08-15T17:54:39.977253+0000","last_became_active":"2024-08-15T17:54:39.976966+0000","last_became_peered":"2024-08-15T17:54:39.976966+0000","last_unstale":"2024-08-15T17:54:39.977253+0000","last_undegraded":"2024-08-15T17:54:39.977253+0000","last_fullsized":"2024-08-15T17:54:39.977253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:00.466080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.980690+0000","last_change":"2024-08-15T17:54:39.980690+0000","last_active":"2024-08-15T17:54:39.980690+0000","last_peered":"2024-08-15T17:54:39.980690+0000","last_clean":"2024-08-15T17:54:39.980690+0000","last_became_active":"2024-08-15T17:54:39.980421+0000","last_became_peered":"2024-08-15T17:54:39.980421+0000","last_unstale":"2024-08-15T17:54:39.980690+0000","last_undegraded":"2024-08-15T17:54:39.980690+0000","last_fullsized":"2024-08-15T17:54:39.980690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:57:58.575423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.971562+0000","last_change":"2024-08-15T17:54:39.967654+0000","last_active":"2024-08-15T17:54:39.971562+0000","last_peered":"2024-08-15T17:54:39.971562+0000","last_clean":"2024-08-15T17:54:39.971562+0000","last_became_active":"2024-08-15T17:54:39.967356+0000","last_became_peered":"2024-08-15T17:54:39.967356+0000","last_unstale":"2024-08-15T17:54:39.971562+0000","last_undegraded":"2024-08-15T17:54:39.971562+0000","last_fullsized":"2024-08-15T17:54:39.971562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:18:29.468896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983138+0000","last_change":"2024-08-15T17:54:39.980222+0000","last_active":"2024-08-15T17:54:39.983138+0000","last_peered":"2024-08-15T17:54:39.983138+0000","last_clean":"2024-08-15T17:54:39.983138+0000","last_became_active":"2024-08-15T17:54:39.979896+0000","last_became_peered":"2024-08-15T17:54:39.979896+0000","last_unstale":"2024-08-15T17:54:39.983138+0000","last_undegraded":"2024-08-15T17:54:39.983138+0000","last_fullsized":"2024-08-15T17:54:39.983138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:46:41.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.993975+0000","last_change":"2024-08-15T17:54:38.989393+0000","last_active":"2024-08-15T17:54:39.993975+0000","last_peered":"2024-08-15T17:54:39.993975+0000","last_clean":"2024-08-15T17:54:39.993975+0000","last_became_active":"2024-08-15T17:54:38.989119+0000","last_became_peered":"2024-08-15T17:54:38.989119+0000","last_unstale":"2024-08-15T17:54:39.993975+0000","last_undegraded":"2024-08-15T17:54:39.993975+0000","last_fullsized":"2024-08-15T17:54:39.993975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:13:21.488263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977111+0000","last_change":"2024-08-15T17:54:39.977111+0000","last_active":"2024-08-15T17:54:39.977111+0000","last_peered":"2024-08-15T17:54:39.977111+0000","last_clean":"2024-08-15T17:54:39.977111+0000","last_became_active":"2024-08-15T17:54:39.976796+0000","last_became_peered":"2024-08-15T17:54:39.976796+0000","last_unstale":"2024-08-15T17:54:39.977111+0000","last_undegraded":"2024-08-15T17:54:39.977111+0000","last_fullsized":"2024-08-15T17:54:39.977111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:35:58.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.982919+0000","last_change":"2024-08-15T17:54:39.979767+0000","last_active":"2024-08-15T17:54:39.982919+0000","last_peered":"2024-08-15T17:54:39.982919+0000","last_clean":"2024-08-15T17:54:39.982919+0000","last_became_active":"2024-08-15T17:54:39.978540+0000","last_became_peered":"2024-08-15T17:54:39.978540+0000","last_unstale":"2024-08-15T17:54:39.982919+0000","last_undegraded":"2024-08-15T17:54:39.982919+0000","last_fullsized":"2024-08-15T17:54:39.982919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:35:58.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.984829+0000","last_change":"2024-08-15T17:54:38.983223+0000","last_active":"2024-08-15T17:54:38.984829+0000","last_peered":"2024-08-15T17:54:38.984829+0000","last_clean":"2024-08-15T17:54:38.984829+0000","last_became_active":"2024-08-15T17:54:38.982987+0000","last_became_peered":"2024-08-15T17:54:38.982987+0000","last_unstale":"2024-08-15T17:54:38.984829+0000","last_undegraded":"2024-08-15T17:54:38.984829+0000","last_fullsized":"2024-08-15T17:54:38.984829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:18.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977487+0000","last_change":"2024-08-15T17:54:39.977487+0000","last_active":"2024-08-15T17:54:39.977487+0000","last_peered":"2024-08-15T17:54:39.977487+0000","last_clean":"2024-08-15T17:54:39.977487+0000","last_became_active":"2024-08-15T17:54:39.977184+0000","last_became_peered":"2024-08-15T17:54:39.977184+0000","last_unstale":"2024-08-15T17:54:39.977487+0000","last_undegraded":"2024-08-15T17:54:39.977487+0000","last_fullsized":"2024-08-15T17:54:39.977487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:09:38.233832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978121+0000","last_change":"2024-08-15T17:54:39.973862+0000","last_active":"2024-08-15T17:54:39.978121+0000","last_peered":"2024-08-15T17:54:39.978121+0000","last_clean":"2024-08-15T17:54:39.978121+0000","last_became_active":"2024-08-15T17:54:39.973419+0000","last_became_peered":"2024-08-15T17:54:39.973419+0000","last_unstale":"2024-08-15T17:54:39.978121+0000","last_undegraded":"2024-08-15T17:54:39.978121+0000","last_fullsized":"2024-08-15T17:54:39.978121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:09:38.233832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998705+0000","last_change":"2024-08-15T17:54:38.983844+0000","last_active":"2024-08-15T17:54:39.998705+0000","last_peered":"2024-08-15T17:54:39.998705+0000","last_clean":"2024-08-15T17:54:39.998705+0000","last_became_active":"2024-08-15T17:54:38.981063+0000","last_became_peered":"2024-08-15T17:54:38.981063+0000","last_unstale":"2024-08-15T17:54:39.998705+0000","last_undegraded":"2024-08-15T17:54:39.998705+0000","last_fullsized":"2024-08-15T17:54:39.998705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:20:13.058962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.988203+0000","last_change":"2024-08-15T17:54:38.982859+0000","last_active":"2024-08-15T17:54:38.988203+0000","last_peered":"2024-08-15T17:54:38.988203+0000","last_clean":"2024-08-15T17:54:38.988203+0000","last_became_active":"2024-08-15T17:54:38.982561+0000","last_became_peered":"2024-08-15T17:54:38.982561+0000","last_unstale":"2024-08-15T17:54:38.988203+0000","last_undegraded":"2024-08-15T17:54:38.988203+0000","last_fullsized":"2024-08-15T17:54:38.988203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:33:52.136024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.971582+0000","last_change":"2024-08-15T17:54:39.968285+0000","last_active":"2024-08-15T17:54:39.971582+0000","last_peered":"2024-08-15T17:54:39.971582+0000","last_clean":"2024-08-15T17:54:39.971582+0000","last_became_active":"2024-08-15T17:54:39.968002+0000","last_became_peered":"2024-08-15T17:54:39.968002+0000","last_unstale":"2024-08-15T17:54:39.971582+0000","last_undegraded":"2024-08-15T17:54:39.971582+0000","last_fullsized":"2024-08-15T17:54:39.971582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:00.120025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978937+0000","last_change":"2024-08-15T17:54:38.986496+0000","last_active":"2024-08-15T17:54:39.978937+0000","last_peered":"2024-08-15T17:54:39.978937+0000","last_clean":"2024-08-15T17:54:39.978937+0000","last_became_active":"2024-08-15T17:54:38.986194+0000","last_became_peered":"2024-08-15T17:54:38.986194+0000","last_unstale":"2024-08-15T17:54:39.978937+0000","last_undegraded":"2024-08-15T17:54:39.978937+0000","last_fullsized":"2024-08-15T17:54:39.978937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:09:37.223121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978306+0000","last_change":"2024-08-15T17:54:38.983495+0000","last_active":"2024-08-15T17:54:39.978306+0000","last_peered":"2024-08-15T17:54:39.978306+0000","last_clean":"2024-08-15T17:54:39.978306+0000","last_became_active":"2024-08-15T17:54:38.983067+0000","last_became_peered":"2024-08-15T17:54:38.983067+0000","last_unstale":"2024-08-15T17:54:39.978306+0000","last_undegraded":"2024-08-15T17:54:39.978306+0000","last_fullsized":"2024-08-15T17:54:39.978306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:18:28.458185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991356+0000","last_change":"2024-08-15T17:54:39.984780+0000","last_active":"2024-08-15T17:54:39.991356+0000","last_peered":"2024-08-15T17:54:39.991356+0000","last_clean":"2024-08-15T17:54:39.991356+0000","last_became_active":"2024-08-15T17:54:39.984181+0000","last_became_peered":"2024-08-15T17:54:39.984181+0000","last_unstale":"2024-08-15T17:54:39.991356+0000","last_undegraded":"2024-08-15T17:54:39.991356+0000","last_fullsized":"2024-08-15T17:54:39.991356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:12:18.198046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979887+0000","last_change":"2024-08-15T17:54:38.987238+0000","last_active":"2024-08-15T17:54:39.979887+0000","last_peered":"2024-08-15T17:54:39.979887+0000","last_clean":"2024-08-15T17:54:39.979887+0000","last_became_active":"2024-08-15T17:54:38.986870+0000","last_became_peered":"2024-08-15T17:54:38.986870+0000","last_unstale":"2024-08-15T17:54:39.979887+0000","last_undegraded":"2024-08-15T17:54:39.979887+0000","last_fullsized":"2024-08-15T17:54:39.979887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:50:59.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.993626+0000","last_change":"2024-08-15T17:54:39.988977+0000","last_active":"2024-08-15T17:54:39.993626+0000","last_peered":"2024-08-15T17:54:39.993626+0000","last_clean":"2024-08-15T17:54:39.993626+0000","last_became_active":"2024-08-15T17:54:39.984965+0000","last_became_peered":"2024-08-15T17:54:39.984965+0000","last_unstale":"2024-08-15T17:54:39.993626+0000","last_undegraded":"2024-08-15T17:54:39.993626+0000","last_fullsized":"2024-08-15T17:54:39.993626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:26:54.762367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.964074+0000","last_change":"2024-08-15T17:54:38.987343+0000","last_active":"2024-08-15T17:54:39.964074+0000","last_peered":"2024-08-15T17:54:39.964074+0000","last_clean":"2024-08-15T17:54:39.964074+0000","last_became_active":"2024-08-15T17:54:38.986961+0000","last_became_peered":"2024-08-15T17:54:38.986961+0000","last_unstale":"2024-08-15T17:54:39.964074+0000","last_undegraded":"2024-08-15T17:54:39.964074+0000","last_fullsized":"2024-08-15T17:54:39.964074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:45:06.434528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:38.949678+0000","last_change":"2024-08-15T17:54:38.949678+0000","last_active":"2024-08-15T17:54:38.949678+0000","last_peered":"2024-08-15T17:54:38.949678+0000","last_clean":"2024-08-15T17:54:38.949678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:38.949678+0000","last_undegraded":"2024-08-15T17:54:38.949678+0000","last_fullsized":"2024-08-15T17:54:38.949678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-15T17:54:37.938967+0000","last_change":"2024-08-15T17:54:37.938967+0000","last_active":"2024-08-15T17:54:37.938967+0000","last_peered":"2024-08-15T17:54:37.938967+0000","last_clean":"2024-08-15T17:54:37.938967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-15T17:54:37.938967+0000","last_undegraded":"2024-08-15T17:54:37.938967+0000","last_fullsized":"2024-08-15T17:54:37.938967+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.980247+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:54:38.980247+0000","last_peered":"2024-08-15T17:54:38.980247+0000","last_clean":"2024-08-15T17:54:38.980247+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:54:38.980247+0000","last_undegraded":"2024-08-15T17:54:38.980247+0000","last_fullsized":"2024-08-15T17:54:38.980247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1574,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":38,"acting":38,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297676,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":315392,"data_stored":116919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297672,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":315392,"data_stored":116919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297668,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":315392,"data_stored":116919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.621}]},{"osd":2,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.752}]},{"osd":3,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.004}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.212},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.91400000000000003}]},{"osd":5,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.115}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.266},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":1.05}]}]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":356352,"data_stored":135772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.105}]},{"osd":1,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.179},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.038}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.147},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.284}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":137302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.103},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.1619999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.3939999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.232}]},{"osd":4,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.47},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.538}]},{"osd":5,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.056}]},{"osd":7,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.355},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":950272,"data_stored":726688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.03},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.216}]},{"osd":7,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.2390000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301880,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069960,"statfs":{"total":96636764160,"available":96327639040,"internally_reserved":0,"allocated":368640,"data_stored":137324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.093}]},{"osd":1,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.627},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.749}]},{"osd":2,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.137}]},{"osd":3,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.179}]},{"osd":5,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.3500000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.2310000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":950272,"data_stored":726188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.04}]},{"osd":5,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.139},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.248}]},{"osd":7,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1910000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:54:43.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:54:44.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 Processor -- start 2024-08-15T17:54:44.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- start start 2024-08-15T17:54:44.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbec8156f80 0x7fbec80ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec80adf50 con 0x7fbec80ace80 2024-08-15T17:54:44.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec80ae920 con 0x7fbec806f040 2024-08-15T17:54:44.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec80ad340 con 0x7fbec8156f80 2024-08-15T17:54:44.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbecc89a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbec8156f80 0x7fbec80ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbec80ace80 0x7fbec8157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53918/0 (socket says 172.21.15.33:53918) 2024-08-15T17:54:44.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec7fff700 1 -- 172.21.15.33:0/535428799 learned_addr learned my addr 172.21.15.33:0/535428799 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec77fe700 1 -- 172.21.15.33:0/535428799 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256946743 0 0) 0x7fbec80adf50 con 0x7fbec80ace80 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec77fe700 1 -- 172.21.15.33:0/535428799 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb0003570 con 0x7fbec80ace80 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbecc89a700 1 -- 172.21.15.33:0/535428799 >> v1:172.21.15.105:6789/0 conn(0x7fbec806f040 legacy=0x7fbec80aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbecc89a700 1 -- 172.21.15.33:0/535428799 >> v1:172.21.15.33:6789/0 conn(0x7fbec80ace80 legacy=0x7fbec8157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbecc89a700 1 -- 172.21.15.33:0/535428799 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80ad620 con 0x7fbec8156f80 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbecc89a700 1 --2- 172.21.15.33:0/535428799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec80ae3e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0098e0 tx=0x7fbebc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c0bc1fd1fc8662 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec77fe700 1 -- 172.21.15.33:0/535428799 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00b640 con 0x7fbec8156f80 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec77fe700 1 -- 172.21.15.33:0/535428799 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00b7a0 con 0x7fbec8156f80 2024-08-15T17:54:44.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbec77fe700 1 -- 172.21.15.33:0/535428799 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00bb40 con 0x7fbec8156f80 2024-08-15T17:54:44.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- 172.21.15.33:0/535428799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 msgr2=0x7fbec80ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 --2- 172.21.15.33:0/535428799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec80ae3e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0098e0 tx=0x7fbebc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- 172.21.15.33:0/535428799 shutdown_connections 2024-08-15T17:54:44.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 --2- 172.21.15.33:0/535428799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec80ae3e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- 172.21.15.33:0/535428799 >> 172.21.15.33:0/535428799 conn(0x7fbec8066e00 msgr2=0x7fbec8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:44.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- 172.21.15.33:0/535428799 shutdown_connections 2024-08-15T17:54:44.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.142+0000 7fbeceafe700 1 -- 172.21.15.33:0/535428799 wait complete. 2024-08-15T17:54:44.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 Processor -- start 2024-08-15T17:54:44.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 -- start start 2024-08-15T17:54:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 0x7fbec80c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec80ace80 0x7fbec8098620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec8167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8098b60 con 0x7fbec8156f80 2024-08-15T17:54:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80c3c90 con 0x7fbec80ace80 2024-08-15T17:54:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.146+0000 7fbeceafe700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80c36d0 con 0x7fbec806f040 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec8167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecc89a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 0x7fbec80c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec8167810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58234/0 (socket says 172.21.15.33:58234) 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecc89a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 0x7fbec80c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:46316/0 (socket says 172.21.15.33:46316) 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 -- 172.21.15.33:0/2964486907 learned_addr learned my addr 172.21.15.33:0/2964486907 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbec7fff700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec80ace80 0x7fbec8098620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 -- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 msgr2=0x7fbec80c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 0x7fbec80c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 -- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec80ace80 msgr2=0x7fbec8098620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec80ace80 0x7fbec8098620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 -- 172.21.15.33:0/2964486907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc009420 con 0x7fbec8156f80 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecc89a700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 0x7fbec80c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:44.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbecd09b700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec8167810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c490 tx=0x7fbec0007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000ce40 con 0x7fbec8156f80 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0011590 con 0x7fbec8156f80 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec80c39b0 con 0x7fbec8156f80 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0011950 con 0x7fbec8156f80 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec80c1440 con 0x7fbec8156f80 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec80c1690 con 0x7fbec8156f80 2024-08-15T17:54:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.150+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbec0011cc0 con 0x7fbec8156f80 2024-08-15T17:54:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.154+0000 7fbec4ff9700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbeb4060860 0x7fbeb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.154+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbec007be90 con 0x7fbec8156f80 2024-08-15T17:54:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.154+0000 7fbecc89a700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbeb4060860 0x7fbeb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.154+0000 7fbecc89a700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbeb4060860 0x7fbeb4062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0093f0 tx=0x7fbebc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.162+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbec004c2e0 con 0x7fbec8156f80 2024-08-15T17:54:44.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.326+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbec80645c0 con 0x7fbeb4060860 2024-08-15T17:54:44.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.346+0000 7fbec4ff9700 1 -- 172.21.15.33:0/2964486907 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286023 (secure 0 0 0) 0x7fbec80645c0 con 0x7fbeb4060860 2024-08-15T17:54:44.351 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:44.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbeb4060860 msgr2=0x7fbeb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbeb4060860 0x7fbeb4062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0093f0 tx=0x7fbebc017000 comp rx=0 tx=0).stop 2024-08-15T17:54:44.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 msgr2=0x7fbec8167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec8167810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c490 tx=0x7fbec0007f20 comp rx=0 tx=0).stop 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 shutdown_connections 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fbeb4060860 0x7fbeb4062d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec80ace80 0x7fbec8098620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbec8156f80 0x7fbec8167810 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 --2- 172.21.15.33:0/2964486907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806f040 0x7fbec80c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 >> 172.21.15.33:0/2964486907 conn(0x7fbec8066e00 msgr2=0x7fbec806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 shutdown_connections 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.350+0000 7fbeceafe700 1 -- 172.21.15.33:0/2964486907 wait complete. 2024-08-15T17:54:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:54:44.368 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-08-15T17:54:44.256163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391208,"kb_used_data":3988,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752583512,"statfs":{"total":773094113280,"available":770645516288,"internally_reserved":0,"allocated":4083712,"data_stored":2277700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002192"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986751+0000","last_change":"2024-08-15T17:54:39.981189+0000","last_active":"2024-08-15T17:54:39.986751+0000","last_peered":"2024-08-15T17:54:39.986751+0000","last_clean":"2024-08-15T17:54:39.986751+0000","last_became_active":"2024-08-15T17:54:39.976950+0000","last_became_peered":"2024-08-15T17:54:39.976950+0000","last_unstale":"2024-08-15T17:54:39.986751+0000","last_undegraded":"2024-08-15T17:54:39.986751+0000","last_fullsized":"2024-08-15T17:54:39.986751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:40:35.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.976600+0000","last_change":"2024-08-15T17:54:39.976600+0000","last_active":"2024-08-15T17:54:39.976600+0000","last_peered":"2024-08-15T17:54:39.976600+0000","last_clean":"2024-08-15T17:54:39.976600+0000","last_became_active":"2024-08-15T17:54:39.976328+0000","last_became_peered":"2024-08-15T17:54:39.976328+0000","last_unstale":"2024-08-15T17:54:39.976600+0000","last_undegraded":"2024-08-15T17:54:39.976600+0000","last_fullsized":"2024-08-15T17:54:39.976600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:32:16.827557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986368+0000","last_change":"2024-08-15T17:54:39.986368+0000","last_active":"2024-08-15T17:54:39.986368+0000","last_peered":"2024-08-15T17:54:39.986368+0000","last_clean":"2024-08-15T17:54:39.986368+0000","last_became_active":"2024-08-15T17:54:39.983917+0000","last_became_peered":"2024-08-15T17:54:39.983917+0000","last_unstale":"2024-08-15T17:54:39.986368+0000","last_undegraded":"2024-08-15T17:54:39.986368+0000","last_fullsized":"2024-08-15T17:54:39.986368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:18:29.468896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991329+0000","last_change":"2024-08-15T17:54:39.986958+0000","last_active":"2024-08-15T17:54:39.991329+0000","last_peered":"2024-08-15T17:54:39.991329+0000","last_clean":"2024-08-15T17:54:39.991329+0000","last_became_active":"2024-08-15T17:54:39.984118+0000","last_became_peered":"2024-08-15T17:54:39.984118+0000","last_unstale":"2024-08-15T17:54:39.991329+0000","last_undegraded":"2024-08-15T17:54:39.991329+0000","last_fullsized":"2024-08-15T17:54:39.991329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:45:19.279041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983721+0000","last_change":"2024-08-15T17:54:39.983721+0000","last_active":"2024-08-15T17:54:39.983721+0000","last_peered":"2024-08-15T17:54:39.983721+0000","last_clean":"2024-08-15T17:54:39.983721+0000","last_became_active":"2024-08-15T17:54:39.983435+0000","last_became_peered":"2024-08-15T17:54:39.983435+0000","last_unstale":"2024-08-15T17:54:39.983721+0000","last_undegraded":"2024-08-15T17:54:39.983721+0000","last_fullsized":"2024-08-15T17:54:39.983721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:25:53.380656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991914+0000","last_change":"2024-08-15T17:54:39.985338+0000","last_active":"2024-08-15T17:54:39.991914+0000","last_peered":"2024-08-15T17:54:39.991914+0000","last_clean":"2024-08-15T17:54:39.991914+0000","last_became_active":"2024-08-15T17:54:39.985026+0000","last_became_peered":"2024-08-15T17:54:39.985026+0000","last_unstale":"2024-08-15T17:54:39.991914+0000","last_undegraded":"2024-08-15T17:54:39.991914+0000","last_fullsized":"2024-08-15T17:54:39.991914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:10:05.432359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.996096+0000","last_change":"2024-08-15T17:54:39.990197+0000","last_active":"2024-08-15T17:54:39.996096+0000","last_peered":"2024-08-15T17:54:39.996096+0000","last_clean":"2024-08-15T17:54:39.996096+0000","last_became_active":"2024-08-15T17:54:39.989885+0000","last_became_peered":"2024-08-15T17:54:39.989885+0000","last_unstale":"2024-08-15T17:54:39.996096+0000","last_undegraded":"2024-08-15T17:54:39.996096+0000","last_fullsized":"2024-08-15T17:54:39.996096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:10:00.947814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.989619+0000","last_change":"2024-08-15T17:54:39.984224+0000","last_active":"2024-08-15T17:54:39.989619+0000","last_peered":"2024-08-15T17:54:39.989619+0000","last_clean":"2024-08-15T17:54:39.989619+0000","last_became_active":"2024-08-15T17:54:39.983806+0000","last_became_peered":"2024-08-15T17:54:39.983806+0000","last_unstale":"2024-08-15T17:54:39.989619+0000","last_undegraded":"2024-08-15T17:54:39.989619+0000","last_fullsized":"2024-08-15T17:54:39.989619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:36:13.592983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977870+0000","last_change":"2024-08-15T17:54:39.977870+0000","last_active":"2024-08-15T17:54:39.977870+0000","last_peered":"2024-08-15T17:54:39.977870+0000","last_clean":"2024-08-15T17:54:39.977870+0000","last_became_active":"2024-08-15T17:54:39.977565+0000","last_became_peered":"2024-08-15T17:54:39.977565+0000","last_unstale":"2024-08-15T17:54:39.977870+0000","last_undegraded":"2024-08-15T17:54:39.977870+0000","last_fullsized":"2024-08-15T17:54:39.977870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:22:46.358665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983608+0000","last_change":"2024-08-15T17:54:39.978002+0000","last_active":"2024-08-15T17:54:39.983608+0000","last_peered":"2024-08-15T17:54:39.983608+0000","last_clean":"2024-08-15T17:54:39.983608+0000","last_became_active":"2024-08-15T17:54:39.977727+0000","last_became_peered":"2024-08-15T17:54:39.977727+0000","last_unstale":"2024-08-15T17:54:39.983608+0000","last_undegraded":"2024-08-15T17:54:39.983608+0000","last_fullsized":"2024-08-15T17:54:39.983608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:04:34.281769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.997018+0000","last_change":"2024-08-15T17:54:39.991115+0000","last_active":"2024-08-15T17:54:39.997018+0000","last_peered":"2024-08-15T17:54:39.997018+0000","last_clean":"2024-08-15T17:54:39.997018+0000","last_became_active":"2024-08-15T17:54:39.990628+0000","last_became_peered":"2024-08-15T17:54:39.990628+0000","last_unstale":"2024-08-15T17:54:39.997018+0000","last_undegraded":"2024-08-15T17:54:39.997018+0000","last_fullsized":"2024-08-15T17:54:39.997018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:29:10.356634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987044+0000","last_change":"2024-08-15T17:54:39.987044+0000","last_active":"2024-08-15T17:54:39.987044+0000","last_peered":"2024-08-15T17:54:39.987044+0000","last_clean":"2024-08-15T17:54:39.987044+0000","last_became_active":"2024-08-15T17:54:39.986723+0000","last_became_peered":"2024-08-15T17:54:39.986723+0000","last_unstale":"2024-08-15T17:54:39.987044+0000","last_undegraded":"2024-08-15T17:54:39.987044+0000","last_fullsized":"2024-08-15T17:54:39.987044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:10:05.432359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987165+0000","last_change":"2024-08-15T17:54:39.982904+0000","last_active":"2024-08-15T17:54:39.987165+0000","last_peered":"2024-08-15T17:54:39.987165+0000","last_clean":"2024-08-15T17:54:39.987165+0000","last_became_active":"2024-08-15T17:54:39.982542+0000","last_became_peered":"2024-08-15T17:54:39.982542+0000","last_unstale":"2024-08-15T17:54:39.987165+0000","last_undegraded":"2024-08-15T17:54:39.987165+0000","last_fullsized":"2024-08-15T17:54:39.987165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:27:11.356760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.974167+0000","last_change":"2024-08-15T17:54:39.971594+0000","last_active":"2024-08-15T17:54:39.974167+0000","last_peered":"2024-08-15T17:54:39.974167+0000","last_clean":"2024-08-15T17:54:39.974167+0000","last_became_active":"2024-08-15T17:54:39.971181+0000","last_became_peered":"2024-08-15T17:54:39.971181+0000","last_unstale":"2024-08-15T17:54:39.974167+0000","last_undegraded":"2024-08-15T17:54:39.974167+0000","last_fullsized":"2024-08-15T17:54:39.974167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:10:00.947814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.984984+0000","last_change":"2024-08-15T17:54:39.984984+0000","last_active":"2024-08-15T17:54:39.984984+0000","last_peered":"2024-08-15T17:54:39.984984+0000","last_clean":"2024-08-15T17:54:39.984984+0000","last_became_active":"2024-08-15T17:54:39.984674+0000","last_became_peered":"2024-08-15T17:54:39.984674+0000","last_unstale":"2024-08-15T17:54:39.984984+0000","last_undegraded":"2024-08-15T17:54:39.984984+0000","last_fullsized":"2024-08-15T17:54:39.984984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:10:00.947814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.968138+0000","last_change":"2024-08-15T17:54:39.968138+0000","last_active":"2024-08-15T17:54:39.968138+0000","last_peered":"2024-08-15T17:54:39.968138+0000","last_clean":"2024-08-15T17:54:39.968138+0000","last_became_active":"2024-08-15T17:54:39.967334+0000","last_became_peered":"2024-08-15T17:54:39.967334+0000","last_unstale":"2024-08-15T17:54:39.968138+0000","last_undegraded":"2024-08-15T17:54:39.968138+0000","last_fullsized":"2024-08-15T17:54:39.968138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:30:30.489555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991822+0000","last_change":"2024-08-15T17:54:39.987544+0000","last_active":"2024-08-15T17:54:39.991822+0000","last_peered":"2024-08-15T17:54:39.991822+0000","last_clean":"2024-08-15T17:54:39.991822+0000","last_became_active":"2024-08-15T17:54:39.987239+0000","last_became_peered":"2024-08-15T17:54:39.987239+0000","last_unstale":"2024-08-15T17:54:39.991822+0000","last_undegraded":"2024-08-15T17:54:39.991822+0000","last_fullsized":"2024-08-15T17:54:39.991822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:47:42.438853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.982178+0000","last_change":"2024-08-15T17:54:39.978239+0000","last_active":"2024-08-15T17:54:39.982178+0000","last_peered":"2024-08-15T17:54:39.982178+0000","last_clean":"2024-08-15T17:54:39.982178+0000","last_became_active":"2024-08-15T17:54:39.977956+0000","last_became_peered":"2024-08-15T17:54:39.977956+0000","last_unstale":"2024-08-15T17:54:39.982178+0000","last_undegraded":"2024-08-15T17:54:39.982178+0000","last_fullsized":"2024-08-15T17:54:39.982178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:33:53.146735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979773+0000","last_change":"2024-08-15T17:54:39.977561+0000","last_active":"2024-08-15T17:54:39.979773+0000","last_peered":"2024-08-15T17:54:39.979773+0000","last_clean":"2024-08-15T17:54:39.979773+0000","last_became_active":"2024-08-15T17:54:39.977274+0000","last_became_peered":"2024-08-15T17:54:39.977274+0000","last_unstale":"2024-08-15T17:54:39.979773+0000","last_undegraded":"2024-08-15T17:54:39.979773+0000","last_fullsized":"2024-08-15T17:54:39.979773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:22:46.358665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987214+0000","last_change":"2024-08-15T17:54:39.981893+0000","last_active":"2024-08-15T17:54:39.987214+0000","last_peered":"2024-08-15T17:54:39.987214+0000","last_clean":"2024-08-15T17:54:39.987214+0000","last_became_active":"2024-08-15T17:54:39.980925+0000","last_became_peered":"2024-08-15T17:54:39.980925+0000","last_unstale":"2024-08-15T17:54:39.987214+0000","last_undegraded":"2024-08-15T17:54:39.987214+0000","last_fullsized":"2024-08-15T17:54:39.987214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:06:14.053471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979958+0000","last_change":"2024-08-15T17:54:39.979958+0000","last_active":"2024-08-15T17:54:39.979958+0000","last_peered":"2024-08-15T17:54:39.979958+0000","last_clean":"2024-08-15T17:54:39.979958+0000","last_became_active":"2024-08-15T17:54:39.979677+0000","last_became_peered":"2024-08-15T17:54:39.979677+0000","last_unstale":"2024-08-15T17:54:39.979958+0000","last_undegraded":"2024-08-15T17:54:39.979958+0000","last_fullsized":"2024-08-15T17:54:39.979958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:14:16.659953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987850+0000","last_change":"2024-08-15T17:54:39.983305+0000","last_active":"2024-08-15T17:54:39.987850+0000","last_peered":"2024-08-15T17:54:39.987850+0000","last_clean":"2024-08-15T17:54:39.987850+0000","last_became_active":"2024-08-15T17:54:39.982999+0000","last_became_peered":"2024-08-15T17:54:39.982999+0000","last_unstale":"2024-08-15T17:54:39.987850+0000","last_undegraded":"2024-08-15T17:54:39.987850+0000","last_fullsized":"2024-08-15T17:54:39.987850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:45:19.279041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986671+0000","last_change":"2024-08-15T17:54:39.981514+0000","last_active":"2024-08-15T17:54:39.986671+0000","last_peered":"2024-08-15T17:54:39.986671+0000","last_clean":"2024-08-15T17:54:39.986671+0000","last_became_active":"2024-08-15T17:54:39.981150+0000","last_became_peered":"2024-08-15T17:54:39.981150+0000","last_unstale":"2024-08-15T17:54:39.986671+0000","last_undegraded":"2024-08-15T17:54:39.986671+0000","last_fullsized":"2024-08-15T17:54:39.986671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:10:00.044550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987806+0000","last_change":"2024-08-15T17:54:39.983251+0000","last_active":"2024-08-15T17:54:39.987806+0000","last_peered":"2024-08-15T17:54:39.987806+0000","last_clean":"2024-08-15T17:54:39.987806+0000","last_became_active":"2024-08-15T17:54:39.982958+0000","last_became_peered":"2024-08-15T17:54:39.982958+0000","last_unstale":"2024-08-15T17:54:39.987806+0000","last_undegraded":"2024-08-15T17:54:39.987806+0000","last_fullsized":"2024-08-15T17:54:39.987806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:56:13.007810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983783+0000","last_change":"2024-08-15T17:54:39.980221+0000","last_active":"2024-08-15T17:54:39.983783+0000","last_peered":"2024-08-15T17:54:39.983783+0000","last_clean":"2024-08-15T17:54:39.983783+0000","last_became_active":"2024-08-15T17:54:39.979839+0000","last_became_peered":"2024-08-15T17:54:39.979839+0000","last_unstale":"2024-08-15T17:54:39.983783+0000","last_undegraded":"2024-08-15T17:54:39.983783+0000","last_fullsized":"2024-08-15T17:54:39.983783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:53:08.266357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983754+0000","last_change":"2024-08-15T17:54:39.979509+0000","last_active":"2024-08-15T17:54:39.983754+0000","last_peered":"2024-08-15T17:54:39.983754+0000","last_clean":"2024-08-15T17:54:39.983754+0000","last_became_active":"2024-08-15T17:54:39.979228+0000","last_became_peered":"2024-08-15T17:54:39.979228+0000","last_unstale":"2024-08-15T17:54:39.983754+0000","last_undegraded":"2024-08-15T17:54:39.983754+0000","last_fullsized":"2024-08-15T17:54:39.983754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:14:07.034482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.974053+0000","last_change":"2024-08-15T17:54:39.974053+0000","last_active":"2024-08-15T17:54:39.974053+0000","last_peered":"2024-08-15T17:54:39.974053+0000","last_clean":"2024-08-15T17:54:39.974053+0000","last_became_active":"2024-08-15T17:54:39.973695+0000","last_became_peered":"2024-08-15T17:54:39.973695+0000","last_unstale":"2024-08-15T17:54:39.974053+0000","last_undegraded":"2024-08-15T17:54:39.974053+0000","last_fullsized":"2024-08-15T17:54:39.974053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:00:36.657366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.993555+0000","last_change":"2024-08-15T17:54:39.987640+0000","last_active":"2024-08-15T17:54:39.993555+0000","last_peered":"2024-08-15T17:54:39.993555+0000","last_clean":"2024-08-15T17:54:39.993555+0000","last_became_active":"2024-08-15T17:54:39.987335+0000","last_became_peered":"2024-08-15T17:54:39.987335+0000","last_unstale":"2024-08-15T17:54:39.993555+0000","last_undegraded":"2024-08-15T17:54:39.993555+0000","last_fullsized":"2024-08-15T17:54:39.993555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:04:34.281769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.974747+0000","last_change":"2024-08-15T17:54:39.974747+0000","last_active":"2024-08-15T17:54:39.974747+0000","last_peered":"2024-08-15T17:54:39.974747+0000","last_clean":"2024-08-15T17:54:39.974747+0000","last_became_active":"2024-08-15T17:54:39.974450+0000","last_became_peered":"2024-08-15T17:54:39.974450+0000","last_unstale":"2024-08-15T17:54:39.974747+0000","last_undegraded":"2024-08-15T17:54:39.974747+0000","last_fullsized":"2024-08-15T17:54:39.974747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:04:34.281769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979312+0000","last_change":"2024-08-15T17:54:39.979312+0000","last_active":"2024-08-15T17:54:39.979312+0000","last_peered":"2024-08-15T17:54:39.979312+0000","last_clean":"2024-08-15T17:54:39.979312+0000","last_became_active":"2024-08-15T17:54:39.979000+0000","last_became_peered":"2024-08-15T17:54:39.979000+0000","last_unstale":"2024-08-15T17:54:39.979312+0000","last_undegraded":"2024-08-15T17:54:39.979312+0000","last_fullsized":"2024-08-15T17:54:39.979312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:40:35.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.989656+0000","last_change":"2024-08-15T17:54:39.984653+0000","last_active":"2024-08-15T17:54:39.989656+0000","last_peered":"2024-08-15T17:54:39.989656+0000","last_clean":"2024-08-15T17:54:39.989656+0000","last_became_active":"2024-08-15T17:54:39.984230+0000","last_became_peered":"2024-08-15T17:54:39.984230+0000","last_unstale":"2024-08-15T17:54:39.989656+0000","last_undegraded":"2024-08-15T17:54:39.989656+0000","last_fullsized":"2024-08-15T17:54:39.989656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:05:08.665773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.989683+0000","last_change":"2024-08-15T17:54:39.985717+0000","last_active":"2024-08-15T17:54:39.989683+0000","last_peered":"2024-08-15T17:54:39.989683+0000","last_clean":"2024-08-15T17:54:39.989683+0000","last_became_active":"2024-08-15T17:54:39.985398+0000","last_became_peered":"2024-08-15T17:54:39.985398+0000","last_unstale":"2024-08-15T17:54:39.989683+0000","last_undegraded":"2024-08-15T17:54:39.989683+0000","last_fullsized":"2024-08-15T17:54:39.989683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:04:21.146372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.982623+0000","last_change":"2024-08-15T17:54:39.979412+0000","last_active":"2024-08-15T17:54:39.982623+0000","last_peered":"2024-08-15T17:54:39.982623+0000","last_clean":"2024-08-15T17:54:39.982623+0000","last_became_active":"2024-08-15T17:54:39.978805+0000","last_became_peered":"2024-08-15T17:54:39.978805+0000","last_unstale":"2024-08-15T17:54:39.982623+0000","last_undegraded":"2024-08-15T17:54:39.982623+0000","last_fullsized":"2024-08-15T17:54:39.982623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:34:04.520899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.997268+0000","last_change":"2024-08-15T17:54:38.980465+0000","last_active":"2024-08-15T17:54:39.997268+0000","last_peered":"2024-08-15T17:54:39.997268+0000","last_clean":"2024-08-15T17:54:39.997268+0000","last_became_active":"2024-08-15T17:54:38.980011+0000","last_became_peered":"2024-08-15T17:54:38.980011+0000","last_unstale":"2024-08-15T17:54:39.997268+0000","last_undegraded":"2024-08-15T17:54:39.997268+0000","last_fullsized":"2024-08-15T17:54:39.997268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:04:33.271058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.984130+0000","last_change":"2024-08-15T17:54:39.980246+0000","last_active":"2024-08-15T17:54:39.984130+0000","last_peered":"2024-08-15T17:54:39.984130+0000","last_clean":"2024-08-15T17:54:39.984130+0000","last_became_active":"2024-08-15T17:54:39.976657+0000","last_became_peered":"2024-08-15T17:54:39.976657+0000","last_unstale":"2024-08-15T17:54:39.984130+0000","last_undegraded":"2024-08-15T17:54:39.984130+0000","last_fullsized":"2024-08-15T17:54:39.984130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:22:24.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998552+0000","last_change":"2024-08-15T17:54:38.987507+0000","last_active":"2024-08-15T17:54:39.998552+0000","last_peered":"2024-08-15T17:54:39.998552+0000","last_clean":"2024-08-15T17:54:39.998552+0000","last_became_active":"2024-08-15T17:54:38.987014+0000","last_became_peered":"2024-08-15T17:54:38.987014+0000","last_unstale":"2024-08-15T17:54:39.998552+0000","last_undegraded":"2024-08-15T17:54:39.998552+0000","last_fullsized":"2024-08-15T17:54:39.998552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:21:40.732997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.993536+0000","last_change":"2024-08-15T17:54:39.987454+0000","last_active":"2024-08-15T17:54:39.993536+0000","last_peered":"2024-08-15T17:54:39.993536+0000","last_clean":"2024-08-15T17:54:39.993536+0000","last_became_active":"2024-08-15T17:54:39.987143+0000","last_became_peered":"2024-08-15T17:54:39.987143+0000","last_unstale":"2024-08-15T17:54:39.993536+0000","last_undegraded":"2024-08-15T17:54:39.993536+0000","last_fullsized":"2024-08-15T17:54:39.993536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:53:08.266357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.997306+0000","last_change":"2024-08-15T17:54:38.983015+0000","last_active":"2024-08-15T17:54:39.997306+0000","last_peered":"2024-08-15T17:54:39.997306+0000","last_clean":"2024-08-15T17:54:39.997306+0000","last_became_active":"2024-08-15T17:54:38.982727+0000","last_became_peered":"2024-08-15T17:54:38.982727+0000","last_unstale":"2024-08-15T17:54:39.997306+0000","last_undegraded":"2024-08-15T17:54:39.997306+0000","last_fullsized":"2024-08-15T17:54:39.997306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:41:12.145176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.988841+0000","last_change":"2024-08-15T17:54:39.977658+0000","last_active":"2024-08-15T17:54:39.988841+0000","last_peered":"2024-08-15T17:54:39.988841+0000","last_clean":"2024-08-15T17:54:39.988841+0000","last_became_active":"2024-08-15T17:54:39.977364+0000","last_became_peered":"2024-08-15T17:54:39.977364+0000","last_unstale":"2024-08-15T17:54:39.988841+0000","last_undegraded":"2024-08-15T17:54:39.988841+0000","last_fullsized":"2024-08-15T17:54:39.988841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:56:13.007810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:40.000048+0000","last_change":"2024-08-15T17:54:38.989027+0000","last_active":"2024-08-15T17:54:40.000048+0000","last_peered":"2024-08-15T17:54:40.000048+0000","last_clean":"2024-08-15T17:54:40.000048+0000","last_became_active":"2024-08-15T17:54:38.988732+0000","last_became_peered":"2024-08-15T17:54:38.988732+0000","last_unstale":"2024-08-15T17:54:40.000048+0000","last_undegraded":"2024-08-15T17:54:40.000048+0000","last_fullsized":"2024-08-15T17:54:40.000048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:43:44.789274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.980132+0000","last_change":"2024-08-15T17:54:39.980132+0000","last_active":"2024-08-15T17:54:39.980132+0000","last_peered":"2024-08-15T17:54:39.980132+0000","last_clean":"2024-08-15T17:54:39.980132+0000","last_became_active":"2024-08-15T17:54:39.978393+0000","last_became_peered":"2024-08-15T17:54:39.978393+0000","last_unstale":"2024-08-15T17:54:39.980132+0000","last_undegraded":"2024-08-15T17:54:39.980132+0000","last_fullsized":"2024-08-15T17:54:39.980132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:00.120025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.996187+0000","last_change":"2024-08-15T17:54:38.983428+0000","last_active":"2024-08-15T17:54:39.996187+0000","last_peered":"2024-08-15T17:54:39.996187+0000","last_clean":"2024-08-15T17:54:39.996187+0000","last_became_active":"2024-08-15T17:54:38.983139+0000","last_became_peered":"2024-08-15T17:54:38.983139+0000","last_unstale":"2024-08-15T17:54:39.996187+0000","last_undegraded":"2024-08-15T17:54:39.996187+0000","last_fullsized":"2024-08-15T17:54:39.996187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:43:44.789274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.984903+0000","last_change":"2024-08-15T17:54:39.980879+0000","last_active":"2024-08-15T17:54:39.984903+0000","last_peered":"2024-08-15T17:54:39.984903+0000","last_clean":"2024-08-15T17:54:39.984903+0000","last_became_active":"2024-08-15T17:54:39.980152+0000","last_became_peered":"2024-08-15T17:54:39.980152+0000","last_unstale":"2024-08-15T17:54:39.984903+0000","last_undegraded":"2024-08-15T17:54:39.984903+0000","last_fullsized":"2024-08-15T17:54:39.984903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:18:55.349838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998866+0000","last_change":"2024-08-15T17:54:38.986379+0000","last_active":"2024-08-15T17:54:39.998866+0000","last_peered":"2024-08-15T17:54:39.998866+0000","last_clean":"2024-08-15T17:54:39.998866+0000","last_became_active":"2024-08-15T17:54:38.986075+0000","last_became_peered":"2024-08-15T17:54:38.986075+0000","last_unstale":"2024-08-15T17:54:39.998866+0000","last_undegraded":"2024-08-15T17:54:39.998866+0000","last_fullsized":"2024-08-15T17:54:39.998866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:42:33.734806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978517+0000","last_change":"2024-08-15T17:54:39.978517+0000","last_active":"2024-08-15T17:54:39.978517+0000","last_peered":"2024-08-15T17:54:39.978517+0000","last_clean":"2024-08-15T17:54:39.978517+0000","last_became_active":"2024-08-15T17:54:39.978216+0000","last_became_peered":"2024-08-15T17:54:39.978216+0000","last_unstale":"2024-08-15T17:54:39.978517+0000","last_undegraded":"2024-08-15T17:54:39.978517+0000","last_fullsized":"2024-08-15T17:54:39.978517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:20:14.069673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.960287+0000","last_change":"2024-08-15T17:54:38.988881+0000","last_active":"2024-08-15T17:54:39.960287+0000","last_peered":"2024-08-15T17:54:39.960287+0000","last_clean":"2024-08-15T17:54:39.960287+0000","last_became_active":"2024-08-15T17:54:38.988600+0000","last_became_peered":"2024-08-15T17:54:38.988600+0000","last_unstale":"2024-08-15T17:54:39.960287+0000","last_undegraded":"2024-08-15T17:54:39.960287+0000","last_fullsized":"2024-08-15T17:54:39.960287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:18.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983326+0000","last_change":"2024-08-15T17:54:39.978597+0000","last_active":"2024-08-15T17:54:39.983326+0000","last_peered":"2024-08-15T17:54:39.983326+0000","last_clean":"2024-08-15T17:54:39.983326+0000","last_became_active":"2024-08-15T17:54:39.978307+0000","last_became_peered":"2024-08-15T17:54:39.978307+0000","last_unstale":"2024-08-15T17:54:39.983326+0000","last_undegraded":"2024-08-15T17:54:39.983326+0000","last_fullsized":"2024-08-15T17:54:39.983326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:57:02.382698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978234+0000","last_change":"2024-08-15T17:54:38.988628+0000","last_active":"2024-08-15T17:54:39.978234+0000","last_peered":"2024-08-15T17:54:39.978234+0000","last_clean":"2024-08-15T17:54:39.978234+0000","last_became_active":"2024-08-15T17:54:38.988371+0000","last_became_peered":"2024-08-15T17:54:38.988371+0000","last_unstale":"2024-08-15T17:54:39.978234+0000","last_undegraded":"2024-08-15T17:54:39.978234+0000","last_fullsized":"2024-08-15T17:54:39.978234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T23:18:41.289741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.989267+0000","last_change":"2024-08-15T17:54:39.983933+0000","last_active":"2024-08-15T17:54:39.989267+0000","last_peered":"2024-08-15T17:54:39.989267+0000","last_clean":"2024-08-15T17:54:39.989267+0000","last_became_active":"2024-08-15T17:54:39.983670+0000","last_became_peered":"2024-08-15T17:54:39.983670+0000","last_unstale":"2024-08-15T17:54:39.989267+0000","last_undegraded":"2024-08-15T17:54:39.989267+0000","last_fullsized":"2024-08-15T17:54:39.989267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:23:13.167405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.988196+0000","last_change":"2024-08-15T17:54:38.983736+0000","last_active":"2024-08-15T17:54:38.988196+0000","last_peered":"2024-08-15T17:54:38.988196+0000","last_clean":"2024-08-15T17:54:38.988196+0000","last_became_active":"2024-08-15T17:54:38.982490+0000","last_became_peered":"2024-08-15T17:54:38.982490+0000","last_unstale":"2024-08-15T17:54:38.988196+0000","last_undegraded":"2024-08-15T17:54:38.988196+0000","last_fullsized":"2024-08-15T17:54:38.988196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:12:50.068074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.981501+0000","last_change":"2024-08-15T17:54:39.977385+0000","last_active":"2024-08-15T17:54:39.981501+0000","last_peered":"2024-08-15T17:54:39.981501+0000","last_clean":"2024-08-15T17:54:39.981501+0000","last_became_active":"2024-08-15T17:54:39.977071+0000","last_became_peered":"2024-08-15T17:54:39.977071+0000","last_unstale":"2024-08-15T17:54:39.981501+0000","last_undegraded":"2024-08-15T17:54:39.981501+0000","last_fullsized":"2024-08-15T17:54:39.981501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:14:16.659953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.988220+0000","last_change":"2024-08-15T17:54:38.983481+0000","last_active":"2024-08-15T17:54:38.988220+0000","last_peered":"2024-08-15T17:54:38.988220+0000","last_clean":"2024-08-15T17:54:38.988220+0000","last_became_active":"2024-08-15T17:54:38.982658+0000","last_became_peered":"2024-08-15T17:54:38.982658+0000","last_unstale":"2024-08-15T17:54:38.988220+0000","last_undegraded":"2024-08-15T17:54:38.988220+0000","last_fullsized":"2024-08-15T17:54:38.988220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:23:24.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.990867+0000","last_change":"2024-08-15T17:54:39.984607+0000","last_active":"2024-08-15T17:54:39.990867+0000","last_peered":"2024-08-15T17:54:39.990867+0000","last_clean":"2024-08-15T17:54:39.990867+0000","last_became_active":"2024-08-15T17:54:39.984313+0000","last_became_peered":"2024-08-15T17:54:39.984313+0000","last_unstale":"2024-08-15T17:54:39.990867+0000","last_undegraded":"2024-08-15T17:54:39.990867+0000","last_fullsized":"2024-08-15T17:54:39.990867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:36:13.592983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.997249+0000","last_change":"2024-08-15T17:54:38.980741+0000","last_active":"2024-08-15T17:54:39.997249+0000","last_peered":"2024-08-15T17:54:39.997249+0000","last_clean":"2024-08-15T17:54:39.997249+0000","last_became_active":"2024-08-15T17:54:38.980434+0000","last_became_peered":"2024-08-15T17:54:38.980434+0000","last_unstale":"2024-08-15T17:54:39.997249+0000","last_undegraded":"2024-08-15T17:54:39.997249+0000","last_fullsized":"2024-08-15T17:54:39.997249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:36:12.582272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.996995+0000","last_change":"2024-08-15T17:54:39.990924+0000","last_active":"2024-08-15T17:54:39.996995+0000","last_peered":"2024-08-15T17:54:39.996995+0000","last_clean":"2024-08-15T17:54:39.996995+0000","last_became_active":"2024-08-15T17:54:39.990264+0000","last_became_peered":"2024-08-15T17:54:39.990264+0000","last_unstale":"2024-08-15T17:54:39.996995+0000","last_undegraded":"2024-08-15T17:54:39.996995+0000","last_fullsized":"2024-08-15T17:54:39.996995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:59:26.458340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.999930+0000","last_change":"2024-08-15T17:54:38.990354+0000","last_active":"2024-08-15T17:54:39.999930+0000","last_peered":"2024-08-15T17:54:39.999930+0000","last_clean":"2024-08-15T17:54:39.999930+0000","last_became_active":"2024-08-15T17:54:38.990157+0000","last_became_peered":"2024-08-15T17:54:38.990157+0000","last_unstale":"2024-08-15T17:54:39.999930+0000","last_undegraded":"2024-08-15T17:54:39.999930+0000","last_fullsized":"2024-08-15T17:54:39.999930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:10:08.460243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.986467+0000","last_change":"2024-08-15T17:54:39.980653+0000","last_active":"2024-08-15T17:54:39.986467+0000","last_peered":"2024-08-15T17:54:39.986467+0000","last_clean":"2024-08-15T17:54:39.986467+0000","last_became_active":"2024-08-15T17:54:39.980247+0000","last_became_peered":"2024-08-15T17:54:39.980247+0000","last_unstale":"2024-08-15T17:54:39.986467+0000","last_undegraded":"2024-08-15T17:54:39.986467+0000","last_fullsized":"2024-08-15T17:54:39.986467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:51:19.148489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.999214+0000","last_change":"2024-08-15T17:54:38.982757+0000","last_active":"2024-08-15T17:54:39.999214+0000","last_peered":"2024-08-15T17:54:39.999214+0000","last_clean":"2024-08-15T17:54:39.999214+0000","last_became_active":"2024-08-15T17:54:38.982433+0000","last_became_peered":"2024-08-15T17:54:38.982433+0000","last_unstale":"2024-08-15T17:54:39.999214+0000","last_undegraded":"2024-08-15T17:54:39.999214+0000","last_fullsized":"2024-08-15T17:54:39.999214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:15:36.707091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991373+0000","last_change":"2024-08-15T17:54:39.984953+0000","last_active":"2024-08-15T17:54:39.991373+0000","last_peered":"2024-08-15T17:54:39.991373+0000","last_clean":"2024-08-15T17:54:39.991373+0000","last_became_active":"2024-08-15T17:54:39.984508+0000","last_became_peered":"2024-08-15T17:54:39.984508+0000","last_unstale":"2024-08-15T17:54:39.991373+0000","last_undegraded":"2024-08-15T17:54:39.991373+0000","last_fullsized":"2024-08-15T17:54:39.991373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:39:20.992056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.964030+0000","last_change":"2024-08-15T17:54:38.987274+0000","last_active":"2024-08-15T17:54:39.964030+0000","last_peered":"2024-08-15T17:54:39.964030+0000","last_clean":"2024-08-15T17:54:39.964030+0000","last_became_active":"2024-08-15T17:54:38.987005+0000","last_became_peered":"2024-08-15T17:54:38.987005+0000","last_unstale":"2024-08-15T17:54:39.964030+0000","last_undegraded":"2024-08-15T17:54:39.964030+0000","last_fullsized":"2024-08-15T17:54:39.964030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:42:33.734806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.987785+0000","last_change":"2024-08-15T17:54:39.983066+0000","last_active":"2024-08-15T17:54:39.987785+0000","last_peered":"2024-08-15T17:54:39.987785+0000","last_clean":"2024-08-15T17:54:39.987785+0000","last_became_active":"2024-08-15T17:54:39.982752+0000","last_became_peered":"2024-08-15T17:54:39.982752+0000","last_unstale":"2024-08-15T17:54:39.987785+0000","last_undegraded":"2024-08-15T17:54:39.987785+0000","last_fullsized":"2024-08-15T17:54:39.987785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:14:16.659953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.964232+0000","last_change":"2024-08-15T17:54:38.988042+0000","last_active":"2024-08-15T17:54:39.964232+0000","last_peered":"2024-08-15T17:54:39.964232+0000","last_clean":"2024-08-15T17:54:39.964232+0000","last_became_active":"2024-08-15T17:54:38.987740+0000","last_became_peered":"2024-08-15T17:54:38.987740+0000","last_unstale":"2024-08-15T17:54:39.964232+0000","last_undegraded":"2024-08-15T17:54:39.964232+0000","last_fullsized":"2024-08-15T17:54:39.964232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:59:03.114891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.989302+0000","last_change":"2024-08-15T17:54:39.985933+0000","last_active":"2024-08-15T17:54:39.989302+0000","last_peered":"2024-08-15T17:54:39.989302+0000","last_clean":"2024-08-15T17:54:39.989302+0000","last_became_active":"2024-08-15T17:54:39.985439+0000","last_became_peered":"2024-08-15T17:54:39.985439+0000","last_unstale":"2024-08-15T17:54:39.989302+0000","last_undegraded":"2024-08-15T17:54:39.989302+0000","last_fullsized":"2024-08-15T17:54:39.989302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:16:35.342106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998717+0000","last_change":"2024-08-15T17:54:38.986325+0000","last_active":"2024-08-15T17:54:39.998717+0000","last_peered":"2024-08-15T17:54:39.998717+0000","last_clean":"2024-08-15T17:54:39.998717+0000","last_became_active":"2024-08-15T17:54:38.986071+0000","last_became_peered":"2024-08-15T17:54:38.986071+0000","last_unstale":"2024-08-15T17:54:39.998717+0000","last_undegraded":"2024-08-15T17:54:39.998717+0000","last_fullsized":"2024-08-15T17:54:39.998717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:14.112077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.988751+0000","last_change":"2024-08-15T17:54:39.982477+0000","last_active":"2024-08-15T17:54:39.988751+0000","last_peered":"2024-08-15T17:54:39.988751+0000","last_clean":"2024-08-15T17:54:39.988751+0000","last_became_active":"2024-08-15T17:54:39.982217+0000","last_became_peered":"2024-08-15T17:54:39.982217+0000","last_unstale":"2024-08-15T17:54:39.988751+0000","last_undegraded":"2024-08-15T17:54:39.988751+0000","last_fullsized":"2024-08-15T17:54:39.988751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:57:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.994054+0000","last_change":"2024-08-15T17:54:38.989354+0000","last_active":"2024-08-15T17:54:39.994054+0000","last_peered":"2024-08-15T17:54:39.994054+0000","last_clean":"2024-08-15T17:54:39.994054+0000","last_became_active":"2024-08-15T17:54:38.989075+0000","last_became_peered":"2024-08-15T17:54:38.989075+0000","last_unstale":"2024-08-15T17:54:39.994054+0000","last_undegraded":"2024-08-15T17:54:39.994054+0000","last_fullsized":"2024-08-15T17:54:39.994054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:36:38.059749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977253+0000","last_change":"2024-08-15T17:54:39.977253+0000","last_active":"2024-08-15T17:54:39.977253+0000","last_peered":"2024-08-15T17:54:39.977253+0000","last_clean":"2024-08-15T17:54:39.977253+0000","last_became_active":"2024-08-15T17:54:39.976966+0000","last_became_peered":"2024-08-15T17:54:39.976966+0000","last_unstale":"2024-08-15T17:54:39.977253+0000","last_undegraded":"2024-08-15T17:54:39.977253+0000","last_fullsized":"2024-08-15T17:54:39.977253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:51:00.466080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.999177+0000","last_change":"2024-08-15T17:54:38.986492+0000","last_active":"2024-08-15T17:54:39.999177+0000","last_peered":"2024-08-15T17:54:39.999177+0000","last_clean":"2024-08-15T17:54:39.999177+0000","last_became_active":"2024-08-15T17:54:38.986214+0000","last_became_peered":"2024-08-15T17:54:38.986214+0000","last_unstale":"2024-08-15T17:54:39.999177+0000","last_undegraded":"2024-08-15T17:54:39.999177+0000","last_fullsized":"2024-08-15T17:54:39.999177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:21:40.732997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.980690+0000","last_change":"2024-08-15T17:54:39.980690+0000","last_active":"2024-08-15T17:54:39.980690+0000","last_peered":"2024-08-15T17:54:39.980690+0000","last_clean":"2024-08-15T17:54:39.980690+0000","last_became_active":"2024-08-15T17:54:39.980421+0000","last_became_peered":"2024-08-15T17:54:39.980421+0000","last_unstale":"2024-08-15T17:54:39.980690+0000","last_undegraded":"2024-08-15T17:54:39.980690+0000","last_fullsized":"2024-08-15T17:54:39.980690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:57:58.575423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.997331+0000","last_change":"2024-08-15T17:54:38.984994+0000","last_active":"2024-08-15T17:54:39.997331+0000","last_peered":"2024-08-15T17:54:39.997331+0000","last_clean":"2024-08-15T17:54:39.997331+0000","last_became_active":"2024-08-15T17:54:38.984677+0000","last_became_peered":"2024-08-15T17:54:38.984677+0000","last_unstale":"2024-08-15T17:54:39.997331+0000","last_undegraded":"2024-08-15T17:54:39.997331+0000","last_fullsized":"2024-08-15T17:54:39.997331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:09:59.937103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.971562+0000","last_change":"2024-08-15T17:54:39.967654+0000","last_active":"2024-08-15T17:54:39.971562+0000","last_peered":"2024-08-15T17:54:39.971562+0000","last_clean":"2024-08-15T17:54:39.971562+0000","last_became_active":"2024-08-15T17:54:39.967356+0000","last_became_peered":"2024-08-15T17:54:39.967356+0000","last_unstale":"2024-08-15T17:54:39.971562+0000","last_undegraded":"2024-08-15T17:54:39.971562+0000","last_fullsized":"2024-08-15T17:54:39.971562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:18:29.468896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.992990+0000","last_change":"2024-08-15T17:54:38.988878+0000","last_active":"2024-08-15T17:54:38.992990+0000","last_peered":"2024-08-15T17:54:38.992990+0000","last_clean":"2024-08-15T17:54:38.992990+0000","last_became_active":"2024-08-15T17:54:38.988511+0000","last_became_peered":"2024-08-15T17:54:38.988511+0000","last_unstale":"2024-08-15T17:54:38.992990+0000","last_undegraded":"2024-08-15T17:54:38.992990+0000","last_fullsized":"2024-08-15T17:54:38.992990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:46:48.801203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.983138+0000","last_change":"2024-08-15T17:54:39.980222+0000","last_active":"2024-08-15T17:54:39.983138+0000","last_peered":"2024-08-15T17:54:39.983138+0000","last_clean":"2024-08-15T17:54:39.983138+0000","last_became_active":"2024-08-15T17:54:39.979896+0000","last_became_peered":"2024-08-15T17:54:39.979896+0000","last_unstale":"2024-08-15T17:54:39.983138+0000","last_undegraded":"2024-08-15T17:54:39.983138+0000","last_fullsized":"2024-08-15T17:54:39.983138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:46:41.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.993975+0000","last_change":"2024-08-15T17:54:38.989393+0000","last_active":"2024-08-15T17:54:39.993975+0000","last_peered":"2024-08-15T17:54:39.993975+0000","last_clean":"2024-08-15T17:54:39.993975+0000","last_became_active":"2024-08-15T17:54:38.989119+0000","last_became_peered":"2024-08-15T17:54:38.989119+0000","last_unstale":"2024-08-15T17:54:39.993975+0000","last_undegraded":"2024-08-15T17:54:39.993975+0000","last_fullsized":"2024-08-15T17:54:39.993975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:13:21.488263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977111+0000","last_change":"2024-08-15T17:54:39.977111+0000","last_active":"2024-08-15T17:54:39.977111+0000","last_peered":"2024-08-15T17:54:39.977111+0000","last_clean":"2024-08-15T17:54:39.977111+0000","last_became_active":"2024-08-15T17:54:39.976796+0000","last_became_peered":"2024-08-15T17:54:39.976796+0000","last_unstale":"2024-08-15T17:54:39.977111+0000","last_undegraded":"2024-08-15T17:54:39.977111+0000","last_fullsized":"2024-08-15T17:54:39.977111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:35:58.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979240+0000","last_change":"2024-08-15T17:54:38.987708+0000","last_active":"2024-08-15T17:54:39.979240+0000","last_peered":"2024-08-15T17:54:39.979240+0000","last_clean":"2024-08-15T17:54:39.979240+0000","last_became_active":"2024-08-15T17:54:38.987430+0000","last_became_peered":"2024-08-15T17:54:38.987430+0000","last_unstale":"2024-08-15T17:54:39.979240+0000","last_undegraded":"2024-08-15T17:54:39.979240+0000","last_fullsized":"2024-08-15T17:54:39.979240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T05:25:19.693544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.982919+0000","last_change":"2024-08-15T17:54:39.979767+0000","last_active":"2024-08-15T17:54:39.982919+0000","last_peered":"2024-08-15T17:54:39.982919+0000","last_clean":"2024-08-15T17:54:39.982919+0000","last_became_active":"2024-08-15T17:54:39.978540+0000","last_became_peered":"2024-08-15T17:54:39.978540+0000","last_unstale":"2024-08-15T17:54:39.982919+0000","last_undegraded":"2024-08-15T17:54:39.982919+0000","last_fullsized":"2024-08-15T17:54:39.982919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:35:58.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.984829+0000","last_change":"2024-08-15T17:54:38.983223+0000","last_active":"2024-08-15T17:54:38.984829+0000","last_peered":"2024-08-15T17:54:38.984829+0000","last_clean":"2024-08-15T17:54:38.984829+0000","last_became_active":"2024-08-15T17:54:38.982987+0000","last_became_peered":"2024-08-15T17:54:38.982987+0000","last_unstale":"2024-08-15T17:54:38.984829+0000","last_undegraded":"2024-08-15T17:54:38.984829+0000","last_fullsized":"2024-08-15T17:54:38.984829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T00:26:18.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.977487+0000","last_change":"2024-08-15T17:54:39.977487+0000","last_active":"2024-08-15T17:54:39.977487+0000","last_peered":"2024-08-15T17:54:39.977487+0000","last_clean":"2024-08-15T17:54:39.977487+0000","last_became_active":"2024-08-15T17:54:39.977184+0000","last_became_peered":"2024-08-15T17:54:39.977184+0000","last_unstale":"2024-08-15T17:54:39.977487+0000","last_undegraded":"2024-08-15T17:54:39.977487+0000","last_fullsized":"2024-08-15T17:54:39.977487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:09:38.233832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.969919+0000","last_change":"2024-08-15T17:54:38.985327+0000","last_active":"2024-08-15T17:54:39.969919+0000","last_peered":"2024-08-15T17:54:39.969919+0000","last_clean":"2024-08-15T17:54:39.969919+0000","last_became_active":"2024-08-15T17:54:38.985011+0000","last_became_peered":"2024-08-15T17:54:38.985011+0000","last_unstale":"2024-08-15T17:54:39.969919+0000","last_undegraded":"2024-08-15T17:54:39.969919+0000","last_fullsized":"2024-08-15T17:54:39.969919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:05:07.655062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978121+0000","last_change":"2024-08-15T17:54:39.973862+0000","last_active":"2024-08-15T17:54:39.978121+0000","last_peered":"2024-08-15T17:54:39.978121+0000","last_clean":"2024-08-15T17:54:39.978121+0000","last_became_active":"2024-08-15T17:54:39.973419+0000","last_became_peered":"2024-08-15T17:54:39.973419+0000","last_unstale":"2024-08-15T17:54:39.978121+0000","last_undegraded":"2024-08-15T17:54:39.978121+0000","last_fullsized":"2024-08-15T17:54:39.978121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:09:38.233832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.998705+0000","last_change":"2024-08-15T17:54:38.983844+0000","last_active":"2024-08-15T17:54:39.998705+0000","last_peered":"2024-08-15T17:54:39.998705+0000","last_clean":"2024-08-15T17:54:39.998705+0000","last_became_active":"2024-08-15T17:54:38.981063+0000","last_became_peered":"2024-08-15T17:54:38.981063+0000","last_unstale":"2024-08-15T17:54:39.998705+0000","last_undegraded":"2024-08-15T17:54:39.998705+0000","last_fullsized":"2024-08-15T17:54:39.998705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:20:13.058962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991796+0000","last_change":"2024-08-15T17:54:39.981811+0000","last_active":"2024-08-15T17:54:39.991796+0000","last_peered":"2024-08-15T17:54:39.991796+0000","last_clean":"2024-08-15T17:54:39.991796+0000","last_became_active":"2024-08-15T17:54:39.981432+0000","last_became_peered":"2024-08-15T17:54:39.981432+0000","last_unstale":"2024-08-15T17:54:39.991796+0000","last_undegraded":"2024-08-15T17:54:39.991796+0000","last_fullsized":"2024-08-15T17:54:39.991796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T02:30:16.753118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.988203+0000","last_change":"2024-08-15T17:54:38.982859+0000","last_active":"2024-08-15T17:54:38.988203+0000","last_peered":"2024-08-15T17:54:38.988203+0000","last_clean":"2024-08-15T17:54:38.988203+0000","last_became_active":"2024-08-15T17:54:38.982561+0000","last_became_peered":"2024-08-15T17:54:38.982561+0000","last_unstale":"2024-08-15T17:54:38.988203+0000","last_undegraded":"2024-08-15T17:54:38.988203+0000","last_fullsized":"2024-08-15T17:54:38.988203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T19:33:52.136024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.971582+0000","last_change":"2024-08-15T17:54:39.968285+0000","last_active":"2024-08-15T17:54:39.971582+0000","last_peered":"2024-08-15T17:54:39.971582+0000","last_clean":"2024-08-15T17:54:39.971582+0000","last_became_active":"2024-08-15T17:54:39.968002+0000","last_became_peered":"2024-08-15T17:54:39.968002+0000","last_unstale":"2024-08-15T17:54:39.971582+0000","last_undegraded":"2024-08-15T17:54:39.971582+0000","last_fullsized":"2024-08-15T17:54:39.971582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:59:00.120025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978937+0000","last_change":"2024-08-15T17:54:38.986496+0000","last_active":"2024-08-15T17:54:39.978937+0000","last_peered":"2024-08-15T17:54:39.978937+0000","last_clean":"2024-08-15T17:54:39.978937+0000","last_became_active":"2024-08-15T17:54:38.986194+0000","last_became_peered":"2024-08-15T17:54:38.986194+0000","last_unstale":"2024-08-15T17:54:39.978937+0000","last_undegraded":"2024-08-15T17:54:39.978937+0000","last_fullsized":"2024-08-15T17:54:39.978937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T03:09:37.223121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.969247+0000","last_change":"2024-08-15T17:54:39.969247+0000","last_active":"2024-08-15T17:54:39.969247+0000","last_peered":"2024-08-15T17:54:39.969247+0000","last_clean":"2024-08-15T17:54:39.969247+0000","last_became_active":"2024-08-15T17:54:39.968403+0000","last_became_peered":"2024-08-15T17:54:39.968403+0000","last_unstale":"2024-08-15T17:54:39.969247+0000","last_undegraded":"2024-08-15T17:54:39.969247+0000","last_fullsized":"2024-08-15T17:54:39.969247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:22:24.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.978306+0000","last_change":"2024-08-15T17:54:38.983495+0000","last_active":"2024-08-15T17:54:39.978306+0000","last_peered":"2024-08-15T17:54:39.978306+0000","last_clean":"2024-08-15T17:54:39.978306+0000","last_became_active":"2024-08-15T17:54:38.983067+0000","last_became_peered":"2024-08-15T17:54:38.983067+0000","last_unstale":"2024-08-15T17:54:39.978306+0000","last_undegraded":"2024-08-15T17:54:39.978306+0000","last_fullsized":"2024-08-15T17:54:39.978306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:18:28.458185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.991356+0000","last_change":"2024-08-15T17:54:39.984780+0000","last_active":"2024-08-15T17:54:39.991356+0000","last_peered":"2024-08-15T17:54:39.991356+0000","last_clean":"2024-08-15T17:54:39.991356+0000","last_became_active":"2024-08-15T17:54:39.984181+0000","last_became_peered":"2024-08-15T17:54:39.984181+0000","last_unstale":"2024-08-15T17:54:39.991356+0000","last_undegraded":"2024-08-15T17:54:39.991356+0000","last_fullsized":"2024-08-15T17:54:39.991356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:12:18.198046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.979887+0000","last_change":"2024-08-15T17:54:38.987238+0000","last_active":"2024-08-15T17:54:39.979887+0000","last_peered":"2024-08-15T17:54:39.979887+0000","last_clean":"2024-08-15T17:54:39.979887+0000","last_became_active":"2024-08-15T17:54:38.986870+0000","last_became_peered":"2024-08-15T17:54:38.986870+0000","last_unstale":"2024-08-15T17:54:39.979887+0000","last_undegraded":"2024-08-15T17:54:39.979887+0000","last_fullsized":"2024-08-15T17:54:39.979887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T18:50:59.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.993626+0000","last_change":"2024-08-15T17:54:39.988977+0000","last_active":"2024-08-15T17:54:39.993626+0000","last_peered":"2024-08-15T17:54:39.993626+0000","last_clean":"2024-08-15T17:54:39.993626+0000","last_became_active":"2024-08-15T17:54:39.984965+0000","last_became_peered":"2024-08-15T17:54:39.984965+0000","last_unstale":"2024-08-15T17:54:39.993626+0000","last_undegraded":"2024-08-15T17:54:39.993626+0000","last_fullsized":"2024-08-15T17:54:39.993626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:26:54.762367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.980139+0000","last_change":"2024-08-15T17:54:38.987820+0000","last_active":"2024-08-15T17:54:39.980139+0000","last_peered":"2024-08-15T17:54:39.980139+0000","last_clean":"2024-08-15T17:54:39.980139+0000","last_became_active":"2024-08-15T17:54:38.987461+0000","last_became_peered":"2024-08-15T17:54:38.987461+0000","last_unstale":"2024-08-15T17:54:39.980139+0000","last_undegraded":"2024-08-15T17:54:39.980139+0000","last_fullsized":"2024-08-15T17:54:39.980139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T04:21:36.857991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.988886+0000","last_change":"2024-08-15T17:54:39.983328+0000","last_active":"2024-08-15T17:54:39.988886+0000","last_peered":"2024-08-15T17:54:39.988886+0000","last_clean":"2024-08-15T17:54:39.988886+0000","last_became_active":"2024-08-15T17:54:39.983008+0000","last_became_peered":"2024-08-15T17:54:39.983008+0000","last_unstale":"2024-08-15T17:54:39.988886+0000","last_undegraded":"2024-08-15T17:54:39.988886+0000","last_fullsized":"2024-08-15T17:54:39.988886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:07:39.060713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.964074+0000","last_change":"2024-08-15T17:54:38.987343+0000","last_active":"2024-08-15T17:54:39.964074+0000","last_peered":"2024-08-15T17:54:39.964074+0000","last_clean":"2024-08-15T17:54:39.964074+0000","last_became_active":"2024-08-15T17:54:38.986961+0000","last_became_peered":"2024-08-15T17:54:38.986961+0000","last_unstale":"2024-08-15T17:54:39.964074+0000","last_undegraded":"2024-08-15T17:54:39.964074+0000","last_fullsized":"2024-08-15T17:54:39.964074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:45:06.434528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.973877+0000","last_change":"2024-08-15T17:54:39.973877+0000","last_active":"2024-08-15T17:54:39.973877+0000","last_peered":"2024-08-15T17:54:39.973877+0000","last_clean":"2024-08-15T17:54:39.973877+0000","last_became_active":"2024-08-15T17:54:39.968840+0000","last_became_peered":"2024-08-15T17:54:39.968840+0000","last_unstale":"2024-08-15T17:54:39.973877+0000","last_undegraded":"2024-08-15T17:54:39.973877+0000","last_fullsized":"2024-08-15T17:54:39.973877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:38.949678+0000","last_clean_scrub_stamp":"2024-08-15T17:54:38.949678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T20:05:08.665773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-15T17:54:39.972766+0000","last_change":"2024-08-15T17:54:38.985206+0000","last_active":"2024-08-15T17:54:39.972766+0000","last_peered":"2024-08-15T17:54:39.972766+0000","last_clean":"2024-08-15T17:54:39.972766+0000","last_became_active":"2024-08-15T17:54:38.984706+0000","last_became_peered":"2024-08-15T17:54:38.984706+0000","last_unstale":"2024-08-15T17:54:39.972766+0000","last_undegraded":"2024-08-15T17:54:39.972766+0000","last_fullsized":"2024-08-15T17:54:39.972766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:54:37.938967+0000","last_clean_scrub_stamp":"2024-08-15T17:54:37.938967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T21:14:15.649241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-15T17:54:38.980247+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:54:38.980247+0000","last_peered":"2024-08-15T17:54:38.980247+0000","last_clean":"2024-08-15T17:54:38.980247+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:54:38.980247+0000","last_undegraded":"2024-08-15T17:54:38.980247+0000","last_fullsized":"2024-08-15T17:54:38.980247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":142802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.749}]},{"osd":1,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.4260000000000002,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.22}]},{"osd":4,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.044}]},{"osd":5,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0179999999999998,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.1519999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":356352,"data_stored":135784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.873}]},{"osd":5,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.153}]},{"osd":6,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.115},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.474}]},{"osd":7,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2809999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":356352,"data_stored":135840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":1.109}]},{"osd":2,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.222},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.046}]},{"osd":5,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.3420000000000001}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":1.294}]}]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":356352,"data_stored":135772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.105}]},{"osd":1,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.179},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.038}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.147},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.284}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":137302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.103},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.1619999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.3939999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.232}]},{"osd":4,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.47},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.538}]},{"osd":5,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.056}]},{"osd":7,"last update":"Thu Aug 15 17:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.355},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":950272,"data_stored":726688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.03},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.216}]},{"osd":7,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.2390000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301880,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069960,"statfs":{"total":96636764160,"available":96327639040,"internally_reserved":0,"allocated":368640,"data_stored":137324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.093}]},{"osd":1,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.627},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.749}]},{"osd":2,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.137}]},{"osd":3,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.179}]},{"osd":5,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.3500000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:54:38 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.2310000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":950272,"data_stored":726188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.04}]},{"osd":5,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.139},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.248}]},{"osd":7,"last update":"Thu Aug 15 17:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1910000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:54:44.373 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-15T17:54:44.374 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-15T17:54:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.490+0000 7fcd5212a700 1 Processor -- start 2024-08-15T17:54:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.490+0000 7fcd5212a700 1 -- start start 2024-08-15T17:54:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.490+0000 7fcd5212a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcd4c153880 0x7fcd4c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.490+0000 7fcd5212a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c0b2460 con 0x7fcd4c1534b0 2024-08-15T17:54:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.490+0000 7fcd5212a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c0ce7f0 con 0x7fcd4c0b2000 2024-08-15T17:54:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.490+0000 7fcd5212a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c0cea90 con 0x7fcd4c153880 2024-08-15T17:54:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd50927700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcd4c153880 0x7fcd4c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd51128700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcd4c1534b0 0x7fcd4c0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53922/0 (socket says 172.21.15.33:53922) 2024-08-15T17:54:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd51128700 1 -- 172.21.15.33:0/3968810251 learned_addr learned my addr 172.21.15.33:0/3968810251 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd3ffff700 1 -- 172.21.15.33:0/3968810251 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230383552 0 0) 0x7fcd4c0ce7f0 con 0x7fcd4c0b2000 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd3ffff700 1 -- 172.21.15.33:0/3968810251 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd38003570 con 0x7fcd4c0b2000 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd50927700 1 -- 172.21.15.33:0/3968810251 >> v1:172.21.15.105:6789/0 conn(0x7fcd4c0b2000 legacy=0x7fcd4c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd3ffff700 1 -- 172.21.15.33:0/3968810251 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114328880 0 0) 0x7fcd48001110 con 0x7fcd4c1534b0 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd50927700 1 -- 172.21.15.33:0/3968810251 >> v1:172.21.15.33:6789/0 conn(0x7fcd4c1534b0 legacy=0x7fcd4c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd50927700 1 -- 172.21.15.33:0/3968810251 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0ced70 con 0x7fcd4c153880 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd50927700 1 --2- 172.21.15.33:0/3968810251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c0b1ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd400098e0 tx=0x7fcd400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5899fdb5e958da17 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd3ffff700 1 -- 172.21.15.33:0/3968810251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000b640 con 0x7fcd4c153880 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd3ffff700 1 -- 172.21.15.33:0/3968810251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000b7a0 con 0x7fcd4c153880 2024-08-15T17:54:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd3ffff700 1 -- 172.21.15.33:0/3968810251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000bb40 con 0x7fcd4c153880 2024-08-15T17:54:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 -- 172.21.15.33:0/3968810251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 msgr2=0x7fcd4c0b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 --2- 172.21.15.33:0/3968810251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c0b1ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd400098e0 tx=0x7fcd400091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 -- 172.21.15.33:0/3968810251 shutdown_connections 2024-08-15T17:54:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 --2- 172.21.15.33:0/3968810251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c0b1ac0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 -- 172.21.15.33:0/3968810251 >> 172.21.15.33:0/3968810251 conn(0x7fcd4c066e00 msgr2=0x7fcd4c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 -- 172.21.15.33:0/3968810251 shutdown_connections 2024-08-15T17:54:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.494+0000 7fcd5212a700 1 -- 172.21.15.33:0/3968810251 wait complete. 2024-08-15T17:54:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 Processor -- start 2024-08-15T17:54:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 -- start start 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd4c0b2000 0x7fcd4c156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd4c1534b0 0x7fcd4c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c156f40 con 0x7fcd4c153880 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c157220 con 0x7fcd4c1534b0 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd5212a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c157500 con 0x7fcd4c0b2000 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd51929700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd51929700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c14aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58246/0 (socket says 172.21.15.33:58246) 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd51929700 1 -- 172.21.15.33:0/892031231 learned_addr learned my addr 172.21.15.33:0/892031231 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:44.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd50927700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd4c1534b0 0x7fcd4c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.498+0000 7fcd51128700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd4c0b2000 0x7fcd4c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51929700 1 -- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd4c0b2000 msgr2=0x7fcd4c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51929700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd4c0b2000 0x7fcd4c156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51929700 1 -- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd4c1534b0 msgr2=0x7fcd4c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51929700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd4c1534b0 0x7fcd4c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51929700 1 -- 172.21.15.33:0/892031231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009420 con 0x7fcd4c153880 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51929700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c14aca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400c910 tx=0x7fcd440027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44012630 con 0x7fcd4c153880 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd440127b0 con 0x7fcd4c153880 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c1577e0 con 0x7fcd4c153880 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44012b70 con 0x7fcd4c153880 2024-08-15T17:54:44.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c158c30 con 0x7fcd4c153880 2024-08-15T17:54:44.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c157ce0 con 0x7fcd4c153880 2024-08-15T17:54:44.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcd4401b400 con 0x7fcd4c153880 2024-08-15T17:54:44.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd3d7fa700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fcd30060860 0x7fcd30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd4407ced0 con 0x7fcd4c153880 2024-08-15T17:54:44.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.502+0000 7fcd51128700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fcd30060860 0x7fcd30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.506+0000 7fcd51128700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fcd30060860 0x7fcd30062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd48007b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.514+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcd4404d320 con 0x7fcd4c153880 2024-08-15T17:54:44.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.734+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcd4c070d10 con 0x7fcd4c153880 2024-08-15T17:54:44.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.742+0000 7fcd3d7fa700 1 -- 172.21.15.33:0/892031231 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcd440160e0 con 0x7fcd4c153880 2024-08-15T17:54:44.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.742+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fcd30060860 msgr2=0x7fcd30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.742+0000 7fcd5212a700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fcd30060860 0x7fcd30062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd48007b70 comp rx=0 tx=0).stop 2024-08-15T17:54:44.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.742+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 msgr2=0x7fcd4c14aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.742+0000 7fcd5212a700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c14aca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400c910 tx=0x7fcd440027a0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 shutdown_connections 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fcd30060860 0x7fcd30062d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd4c1534b0 0x7fcd4c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c153880 0x7fcd4c14aca0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 --2- 172.21.15.33:0/892031231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd4c0b2000 0x7fcd4c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 >> 172.21.15.33:0/892031231 conn(0x7fcd4c066e00 msgr2=0x7fcd4c150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 shutdown_connections 2024-08-15T17:54:44.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.746+0000 7fcd5212a700 1 -- 172.21.15.33:0/892031231 wait complete. 2024-08-15T17:54:44.748 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-08-15T17:54:44.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:54:44.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 Processor -- start 2024-08-15T17:54:44.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 -- start start 2024-08-15T17:54:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f9c159810 0x7f1f9c0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f9c0d0dd0 0x7f1f9c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9c0cf3e0 con 0x7f1f9c0cef80 2024-08-15T17:54:44.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c0c5c60 con 0x7f1f9c159810 2024-08-15T17:54:44.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1fa163c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c0ce120 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f9c159810 0x7f1f9c0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f9c159810 0x7f1f9c0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58256/0 (socket says 172.21.15.33:58256) 2024-08-15T17:54:44.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 -- 172.21.15.33:0/3672040865 learned_addr learned my addr 172.21.15.33:0/3672040865 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:44.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9a7fc700 1 --2- 172.21.15.33:0/3672040865 >> v2:172.21.15.105:3300/0 conn(0x7f1f9c0d0dd0 0x7f1f9c0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 -- 172.21.15.33:0/3672040865 >> v2:172.21.15.105:3300/0 conn(0x7f1f9c0d0dd0 msgr2=0x7f1f9c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:44.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 --2- 172.21.15.33:0/3672040865 >> v2:172.21.15.105:3300/0 conn(0x7f1f9c0d0dd0 0x7f1f9c0cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 -- 172.21.15.33:0/3672040865 >> v1:172.21.15.105:6789/0 conn(0x7f1f9c0cef80 legacy=0x7f1f9c0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 -- 172.21.15.33:0/3672040865 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c0ce390 con 0x7f1f9c159810 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f9affd700 1 --2- 172.21.15.33:0/3672040865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c159810 0x7f1f9c0b3270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c06fae0 tx=0x7f1f94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9965b4d262f0653d server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f99ffb700 1 -- 172.21.15.33:0/3672040865 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400e070 con 0x7f1f9c159810 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f99ffb700 1 -- 172.21.15.33:0/3672040865 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9400ba50 con 0x7f1f9c159810 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.866+0000 7f1f99ffb700 1 -- 172.21.15.33:0/3672040865 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940092e0 con 0x7f1f9c159810 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 -- 172.21.15.33:0/3672040865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c159810 msgr2=0x7f1f9c0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 --2- 172.21.15.33:0/3672040865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c159810 0x7f1f9c0b3270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c06fae0 tx=0x7f1f94009840 comp rx=0 tx=0).stop 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 -- 172.21.15.33:0/3672040865 shutdown_connections 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 --2- 172.21.15.33:0/3672040865 >> v2:172.21.15.105:3300/0 conn(0x7f1f9c0d0dd0 0x7f1f9c0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 --2- 172.21.15.33:0/3672040865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c159810 0x7f1f9c0b3270 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 -- 172.21.15.33:0/3672040865 >> 172.21.15.33:0/3672040865 conn(0x7f1f9c067590 msgr2=0x7f1f9c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 -- 172.21.15.33:0/3672040865 shutdown_connections 2024-08-15T17:54:44.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 -- 172.21.15.33:0/3672040865 wait complete. 2024-08-15T17:54:44.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 Processor -- start 2024-08-15T17:54:44.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.870+0000 7f1fa163c700 1 -- start start 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f9c0cef80 0x7f1f9c16a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 0x7f1f9c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f9c159810 0x7f1f9c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c154120 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c0cb370 con 0x7f1f9c159810 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c153880 con 0x7f1f9c0cef80 2024-08-15T17:54:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 0x7f1f9c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 0x7f1f9c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58272/0 (socket says 172.21.15.33:58272) 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 -- 172.21.15.33:0/1288479380 learned_addr learned my addr 172.21.15.33:0/1288479380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9b7fe700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f9c159810 0x7f1f9c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9affd700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f9c0cef80 0x7f1f9c16a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 -- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f9c0cef80 msgr2=0x7f1f9c16a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f9c0cef80 0x7f1f9c16a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 -- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f9c159810 msgr2=0x7f1f9c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f9c159810 0x7f1f9c150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 -- 172.21.15.33:0/1288479380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94009ae0 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9affd700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f9c0cef80 0x7f1f9c16a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f9a7fc700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 0x7f1f9c152f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000d890 tx=0x7f1f90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900125f0 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90012750 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9c153b60 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012ad0 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c153490 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.874+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c0cb140 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.878+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1f9001e460 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.878+0000 7f1f82ffd700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f88060860 0x7f1f88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:44.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.878+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f9007d240 con 0x7f1f9c0d0dd0 2024-08-15T17:54:44.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.878+0000 7f1f9affd700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f88060860 0x7f1f88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:44.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.878+0000 7f1f9affd700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f88060860 0x7f1f88062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009880 tx=0x7f1f94018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:44.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:44.886+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1f9c0cb140 con 0x7f1f9c0d0dd0 2024-08-15T17:54:45.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.086+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f9c0cb140 con 0x7f1f9c0d0dd0 2024-08-15T17:54:45.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.086+0000 7f1f82ffd700 1 -- 172.21.15.33:0/1288479380 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1f9c0cb140 con 0x7f1f9c0d0dd0 2024-08-15T17:54:45.088 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:45.088 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:39.333104+0000","modified":"2024-08-15T17:54:42.968502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5002":{"gid":5002,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2964556950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2964556950},{"type":"v1","addr":"172.21.15.105:6837","nonce":2964556950}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.086+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f88060860 msgr2=0x7f1f88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.086+0000 7f1fa163c700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f88060860 0x7f1f88062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009880 tx=0x7f1f94018000 comp rx=0 tx=0).stop 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 msgr2=0x7f1f9c152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 0x7f1f9c152f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000d890 tx=0x7f1f90008040 comp rx=0 tx=0).stop 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 shutdown_connections 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f88060860 0x7f1f88062d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f9c159810 0x7f1f9c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f9c0d0dd0 0x7f1f9c152f50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 --2- 172.21.15.33:0/1288479380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f9c0cef80 0x7f1f9c16a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 >> 172.21.15.33:0/1288479380 conn(0x7f1f9c067590 msgr2=0x7f1f9c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 shutdown_connections 2024-08-15T17:54:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.090+0000 7f1fa163c700 1 -- 172.21.15.33:0/1288479380 wait complete. 2024-08-15T17:54:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-08-15T17:54:45.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-15T17:54:39.333104+0000', 'modified': '2024-08-15T17:54:42.968502+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5002}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5002': {'gid': 5002, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6837/2964556950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6835', 'nonce': 2964556950}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 2964556950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-15T17:54:45.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-15T17:54:45.506 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-15T17:54:45.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 Processor -- start 2024-08-15T17:54:45.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 -- start start 2024-08-15T17:54:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe9f4155d20 0x7fe9f40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 0x7fe9f406e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f406e8b0 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40adc10 con 0x7fe9f4155d20 2024-08-15T17:54:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9f33700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f40af2b0 con 0x7fe9f406df10 2024-08-15T17:54:45.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9732700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 0x7fe9f406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9732700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 0x7fe9f406e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:46344/0 (socket says 172.21.15.33:46344) 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f9732700 1 -- 172.21.15.33:0/2837638667 learned_addr learned my addr 172.21.15.33:0/2837638667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.622+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/2837638667 >> v2:172.21.15.105:3300/0 conn(0x7fe9f4155d20 0x7fe9f40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9732700 1 -- 172.21.15.33:0/2837638667 >> v2:172.21.15.105:3300/0 conn(0x7fe9f4155d20 msgr2=0x7fe9f40b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9732700 1 --2- 172.21.15.33:0/2837638667 >> v2:172.21.15.105:3300/0 conn(0x7fe9f4155d20 0x7fe9f40b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9732700 1 -- 172.21.15.33:0/2837638667 >> v1:172.21.15.105:6789/0 conn(0x7fe9f40ad7c0 legacy=0x7fe9f40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f37fe700 1 -- 172.21.15.33:0/2837638667 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522487577 0 0) 0x7fe9e4001110 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9732700 1 -- 172.21.15.33:0/2837638667 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40af590 con 0x7fe9f406df10 2024-08-15T17:54:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9732700 1 --2- 172.21.15.33:0/2837638667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 0x7fe9f406e370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009f20 tx=0x7fe9ec009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b71f966c193312c server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f37fe700 1 -- 172.21.15.33:0/2837638667 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00e070 con 0x7fe9f406df10 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f37fe700 1 -- 172.21.15.33:0/2837638667 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00b9d0 con 0x7fe9f406df10 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f37fe700 1 -- 172.21.15.33:0/2837638667 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0092e0 con 0x7fe9f406df10 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 -- 172.21.15.33:0/2837638667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 msgr2=0x7fe9f406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/2837638667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 0x7fe9f406e370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009f20 tx=0x7fe9ec009840 comp rx=0 tx=0).stop 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 -- 172.21.15.33:0/2837638667 shutdown_connections 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/2837638667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f406df10 0x7fe9f406e370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/2837638667 >> v2:172.21.15.105:3300/0 conn(0x7fe9f4155d20 0x7fe9f40b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 -- 172.21.15.33:0/2837638667 >> 172.21.15.33:0/2837638667 conn(0x7fe9f40678d0 msgr2=0x7fe9f4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 -- 172.21.15.33:0/2837638667 shutdown_connections 2024-08-15T17:54:45.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 -- 172.21.15.33:0/2837638667 wait complete. 2024-08-15T17:54:45.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 Processor -- start 2024-08-15T17:54:45.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.626+0000 7fe9f9f33700 1 -- start start 2024-08-15T17:54:45.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9f406df10 0x7fe9f413d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9f40ad7c0 0x7fe9f41519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f4155d20 0x7fe9f4151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f413dc70 con 0x7fe9f406df10 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f413d720 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4152580 con 0x7fe9f4155d20 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9f406df10 0x7fe9f413d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9732700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f4155d20 0x7fe9f4151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9f40ad7c0 0x7fe9f41519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9732700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f4155d20 0x7fe9f4151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:46360/0 (socket says 172.21.15.33:46360) 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9732700 1 -- 172.21.15.33:0/4117885309 learned_addr learned my addr 172.21.15.33:0/4117885309 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9f406df10 0x7fe9f413d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58276/0 (socket says 172.21.15.33:58276) 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 -- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f4155d20 msgr2=0x7fe9f4151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f4155d20 0x7fe9f4151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 -- 172.21.15.33:0/4117885309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9f406df10 msgr2=0x7fe9f413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9f406df10 0x7fe9f413d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 -- 172.21.15.33:0/4117885309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec009ae0 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9f40ad7c0 0x7fe9f41519e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c7e0 tx=0x7fe9e4007ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f0ff9700 1 -- 172.21.15.33:0/4117885309 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011590 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f0ff9700 1 -- 172.21.15.33:0/4117885309 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4011710 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4152860 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f0ff9700 1 -- 172.21.15.33:0/4117885309 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011ad0 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.630+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f414c9a0 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.634+0000 7fe9f0ff9700 1 -- 172.21.15.33:0/4117885309 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe9e401b3b0 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.634+0000 7fe9f0ff9700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe9d4060860 0x7fe9d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.634+0000 7fe9f0ff9700 1 -- 172.21.15.33:0/4117885309 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9e407bdc0 con 0x7fe9f40ad7c0 2024-08-15T17:54:45.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.634+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe9d4060860 0x7fe9d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.634+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe9d4060860 0x7fe9d4062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9f414fc50 tx=0x7fe9dc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.634+0000 7fe9fd444740 1 Processor -- start 2024-08-15T17:54:45.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 -- start start 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x1182710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x1185c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x10faba0 con 0xf4eae0 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x10f6b40 con 0xf4e710 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x10bc0a0 con 0xf99790 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11821d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58290/0 (socket says 172.21.15.33:58290) 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 -- 172.21.15.33:0/407258641 learned_addr learned my addr 172.21.15.33:0/407258641 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x1182710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f9732700 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x1185c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 -- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 msgr2=0x1185c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x1185c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 -- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 msgr2=0x1182710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x1182710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 -- 172.21.15.33:0/407258641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf9a9e0 con 0xf4eae0 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x1182710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11821d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc011dc0 tx=0x7fe9dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d7d67f3b27a3b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9e9ffb700 1 -- 172.21.15.33:0/407258641 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc014e70 con 0xf4eae0 2024-08-15T17:54:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9e9ffb700 1 -- 172.21.15.33:0/407258641 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc011ea0 con 0xf4eae0 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.638+0000 7fe9e9ffb700 1 -- 172.21.15.33:0/407258641 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc020620 con 0xf4eae0 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- 172.21.15.33:0/407258641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 msgr2=0x11821d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11821d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc011dc0 tx=0x7fe9dc019000 comp rx=0 tx=0).stop 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- 172.21.15.33:0/407258641 shutdown_connections 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x1182710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x1185c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- 172.21.15.33:0/407258641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11821d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- 172.21.15.33:0/407258641 >> 172.21.15.33:0/407258641 conn(0xf4eeb0 msgr2=0x11880b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- 172.21.15.33:0/407258641 shutdown_connections 2024-08-15T17:54:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- 172.21.15.33:0/407258641 wait complete. 2024-08-15T17:54:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- start start 2024-08-15T17:54:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 Processor -- start 2024-08-15T17:54:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x11cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x118a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x10bbd40 con 0xf4eae0 2024-08-15T17:54:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1094970 con 0xf4e710 2024-08-15T17:54:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x114c330 con 0xf99790 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9fd444740 10 client.0 _ll_register_callbacks cb 0x1098f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x11cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x11cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:50396/0 (socket says 172.21.15.33:50396) 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9f9732700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x118a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.642+0000 7fe9f8f31700 1 -- 172.21.15.33:0/297009292 learned_addr learned my addr 172.21.15.33:0/297009292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f9732700 1 -- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 msgr2=0x11cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f9732700 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x11cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f9732700 1 -- 172.21.15.33:0/297009292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 msgr2=0x11cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f9732700 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f9732700 1 -- 172.21.15.33:0/297009292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc011a50 con 0xf99790 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f9732700 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x118a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00b610 tx=0x7fe9ec018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ffa80198e20d6c server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3301/0 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/297009292 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec023070 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/297009292 <== mon.2 v2:172.21.15.105:3301/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9ec028ad0 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf5c260 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/297009292 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9ec028ea0 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 10 client.4907 fetch_fsmap learned FSMap version 14 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x10c4370 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/297009292 <== mon.2 v2:172.21.15.105:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf5c260 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/297009292 <== mon.2 v2:172.21.15.105:3301/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe9ec00b050 con 0xf99790 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 10 client.4907 fetch_fsmap finished waiting for FSMap version 14 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 10 client.4907 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 20 client.4907 populate_metadata read hostname 'smithi033' 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11d8a20 0x11dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 4 client.4907 mds_command: new command op to 5002 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-15T17:54:45.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 --> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfa64e0 con 0x11d8a20 2024-08-15T17:54:45.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11d8a20 0x11dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11d8a20 0x11dae00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb19ade4398b901 server_cookie=70a8e4f1fdfbbfc2 in_seq=0 out_seq=0 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.646+0000 7fe9d2ffd700 10 client.4907 ms_handle_connect on v2:172.21.15.105:6835/2964556950 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/297009292 <== mds.0 v2:172.21.15.105:6835/2964556950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0xfa64e0 con 0x11d8a20 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9d2ffd700 10 client.4907 handle_command_reply: tid=0 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 client.4907 shutdown 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 msgr2=0x118a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x118a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00b610 tx=0x7fe9ec018000 comp rx=0 tx=0).stop 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 shutdown_connections 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11d8a20 0x11dae00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x118a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9d2ffd700 0 client.4907 ms_handle_reset on v2:172.21.15.105:6835/2964556950 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x11cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 --2- 172.21.15.33:0/297009292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x11cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 >> 172.21.15.33:0/297009292 conn(0xf4eeb0 msgr2=0x1183c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 shutdown_connections 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 1 -- 172.21.15.33:0/297009292 wait complete. 2024-08-15T17:54:45.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.650+0000 7fe9fd444740 20 client.4907 trim_cache size 0 max 16384 2024-08-15T17:54:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 Processor -- start 2024-08-15T17:54:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 -- start start 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x122bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x122c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x122c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x10f2650 con 0xf4eae0 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x10ce570 con 0xf4e710 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x10f9200 con 0xf99790 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x122c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x122c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58316/0 (socket says 172.21.15.33:58316) 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x122bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9f3fff700 1 -- 172.21.15.33:0/3558191260 learned_addr learned my addr 172.21.15.33:0/3558191260 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.670+0000 7fe9f9732700 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x122c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9f8f31700 1 -- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 msgr2=0x122c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x122c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9f8f31700 1 -- 172.21.15.33:0/3558191260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 msgr2=0x122c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x122c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9f8f31700 1 -- 172.21.15.33:0/3558191260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10aad80 con 0xf4e710 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x122bd10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc011930 tx=0x7fe9dc022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=585f3a0f463e183a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/3558191260 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc02f040 con 0xf4e710 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/3558191260 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc030040 con 0xf4e710 2024-08-15T17:54:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/3558191260 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc020410 con 0xf4e710 2024-08-15T17:54:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 -- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 msgr2=0x122bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x122bd10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc011930 tx=0x7fe9dc022000 comp rx=0 tx=0).stop 2024-08-15T17:54:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 -- 172.21.15.33:0/3558191260 shutdown_connections 2024-08-15T17:54:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf99790 0x122c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4eae0 0x122c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 --2- 172.21.15.33:0/3558191260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf4e710 0x122bd10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 -- 172.21.15.33:0/3558191260 >> 172.21.15.33:0/3558191260 conn(0xf4eeb0 msgr2=0x11d5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 -- 172.21.15.33:0/3558191260 shutdown_connections 2024-08-15T17:54:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 -- 172.21.15.33:0/3558191260 wait complete. 2024-08-15T17:54:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 -- start start 2024-08-15T17:54:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.674+0000 7fe9fd444740 1 Processor -- start 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 0x11db880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf4eae0 0x11ec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf99790 0x11ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x10f59d0 con 0xf4e710 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x10f4500 con 0xf99790 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x10a5140 con 0xf4eae0 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 10 client.0 _ll_register_callbacks cb 0xf1a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 0x11db880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 0x11db880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58326/0 (socket says 172.21.15.33:58326) 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 -- 172.21.15.33:0/2431365315 learned_addr learned my addr 172.21.15.33:0/2431365315 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f9732700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf99790 0x11ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf4eae0 0x11ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 -- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf4eae0 msgr2=0x11ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf4eae0 0x11ec490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 -- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf99790 msgr2=0x11ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf99790 0x11ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 -- 172.21.15.33:0/2431365315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf9a9e0 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9f8f31700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 0x11db880 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0095d0 tx=0x7fe9dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9ad4dd75b1ae27 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/2431365315 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc02f050 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/2431365315 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9dc01a040 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9dc011ea0 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/2431365315 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9dc020e30 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.678+0000 7fe9fd444740 10 client.5166 fetch_fsmap learned FSMap version 14 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x109f130 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/2431365315 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc011ea0 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/2431365315 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe9dc03c070 con 0xf4e710 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 10 client.5166 fetch_fsmap finished waiting for FSMap version 14 2024-08-15T17:54:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 10 client.5166 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-15T17:54:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 20 client.5166 populate_metadata read hostname 'smithi033' 2024-08-15T17:54:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11ecf10 0x122fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 4 client.5166 mds_command: new command op to 5002 tid=0[{"prefix": "status"}] 2024-08-15T17:54:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 --> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] -- command(tid 0: {"prefix": "status"}) v1 -- 0xfcb260 con 0x11ecf10 2024-08-15T17:54:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11ecf10 0x122fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9d2ffd700 10 client.5166 ms_handle_connect on v2:172.21.15.105:6835/2964556950 2024-08-15T17:54:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f3fff700 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11ecf10 0x122fce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c22bfbc0a2950ea server_cookie=68e62e8e9c5e1489 in_seq=0 out_seq=0 2024-08-15T17:54:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9d2ffd700 1 -- 172.21.15.33:0/2431365315 <== mds.0 v2:172.21.15.105:6835/2964556950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xfcb260 con 0x11ecf10 2024-08-15T17:54:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9d2ffd700 10 client.5166 handle_command_reply: tid=0 2024-08-15T17:54:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 client.5166 shutdown 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 msgr2=0x11db880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 0x11db880 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0095d0 tx=0x7fe9dc017000 comp rx=0 tx=0).stop 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 shutdown_connections 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:6835/2964556950,v1:172.21.15.105:6837/2964556950] conn(0x11ecf10 0x122fce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xf99790 0x11ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xf4eae0 0x11ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9d2ffd700 0 client.5166 ms_handle_reset on v2:172.21.15.105:6835/2964556950 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 --2- 172.21.15.33:0/2431365315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0xf4e710 0x11db880 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 >> 172.21.15.33:0/2431365315 conn(0xf4eeb0 msgr2=0x11898b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 shutdown_connections 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 1 -- 172.21.15.33:0/2431365315 wait complete. 2024-08-15T17:54:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9fd444740 20 client.5166 trim_cache size 0 max 16384 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "55bddac8-0f58-4a43-a3ea-a8daa20f3e0c", 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5002, 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.7050148719999996, 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 14, 2024-08-15T17:54:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 33, 2024-08-15T17:54:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 33, 2024-08-15T17:54:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 12.907107570000001 2024-08-15T17:54:45.689 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe9d4060860 msgr2=0x7fe9d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe9d4060860 0x7fe9d4062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9f414fc50 tx=0x7fe9dc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9f40ad7c0 msgr2=0x7fe9f41519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9f40ad7c0 0x7fe9f41519e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c7e0 tx=0x7fe9e4007ba0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 shutdown_connections 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe9d4060860 0x7fe9d4062d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9f40ad7c0 0x7fe9f41519e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9f4155d20 0x7fe9f4151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 --2- 172.21.15.33:0/4117885309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9f406df10 0x7fe9f413d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.682+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 >> 172.21.15.33:0/4117885309 conn(0x7fe9f40678d0 msgr2=0x7fe9f4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.686+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 shutdown_connections 2024-08-15T17:54:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.686+0000 7fe9f9f33700 1 -- 172.21.15.33:0/4117885309 wait complete. 2024-08-15T17:54:45.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-15T17:54:45.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.814+0000 7ff5c462f700 1 Processor -- start 2024-08-15T17:54:45.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.814+0000 7ff5c462f700 1 -- start start 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c462f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff5bc159240 0x7ff5bc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c462f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc0c6c80 0x7ff5bc06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c462f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc0c7dc0 con 0x7ff5bc159610 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c462f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc0c71b0 con 0x7ff5bc159240 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c462f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0c7490 con 0x7ff5bc0c6c80 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c23cb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff5bc159240 0x7ff5bc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c2bcc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff5bc159610 0x7ff5bc0686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53928/0 (socket says 172.21.15.33:53928) 2024-08-15T17:54:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c2bcc700 1 -- 172.21.15.33:0/439637988 learned_addr learned my addr 172.21.15.33:0/439637988 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c1bca700 1 --2- 172.21.15.33:0/439637988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc0c6c80 0x7ff5bc06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c23cb700 1 -- 172.21.15.33:0/439637988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc0c6c80 msgr2=0x7ff5bc06ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c23cb700 1 --2- 172.21.15.33:0/439637988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc0c6c80 0x7ff5bc06ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c13c9700 1 -- 172.21.15.33:0/439637988 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862725529 0 0) 0x7ff5bc0c7dc0 con 0x7ff5bc159610 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c23cb700 1 -- 172.21.15.33:0/439637988 >> v1:172.21.15.33:6789/0 conn(0x7ff5bc159610 legacy=0x7ff5bc0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c23cb700 1 -- 172.21.15.33:0/439637988 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0c7770 con 0x7ff5bc159240 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c23cb700 1 --2- 172.21.15.33:0/439637988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159240 0x7ff5bc0af5d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098e0 tx=0x7ff5b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f0de574167680e server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c13c9700 1 -- 172.21.15.33:0/439637988 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800b640 con 0x7ff5bc159240 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c13c9700 1 -- 172.21.15.33:0/439637988 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800b7a0 con 0x7ff5bc159240 2024-08-15T17:54:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.818+0000 7ff5c13c9700 1 -- 172.21.15.33:0/439637988 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800bb40 con 0x7ff5bc159240 2024-08-15T17:54:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- 172.21.15.33:0/439637988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159240 msgr2=0x7ff5bc0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 --2- 172.21.15.33:0/439637988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159240 0x7ff5bc0af5d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098e0 tx=0x7ff5b80091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- 172.21.15.33:0/439637988 shutdown_connections 2024-08-15T17:54:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 --2- 172.21.15.33:0/439637988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc0c6c80 0x7ff5bc06ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 --2- 172.21.15.33:0/439637988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159240 0x7ff5bc0af5d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- 172.21.15.33:0/439637988 >> 172.21.15.33:0/439637988 conn(0x7ff5bc0c9c20 msgr2=0x7ff5bc06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- 172.21.15.33:0/439637988 shutdown_connections 2024-08-15T17:54:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- 172.21.15.33:0/439637988 wait complete. 2024-08-15T17:54:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 Processor -- start 2024-08-15T17:54:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- start start 2024-08-15T17:54:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5bc0c6c80 0x7ff5bc1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc159240 0x7ff5bc0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 0x7ff5bc0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc147ab0 con 0x7ff5bc159610 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc147d90 con 0x7ff5bc0c6c80 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c462f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc148070 con 0x7ff5bc159240 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c2bcc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 0x7ff5bc0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c2bcc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 0x7ff5bc0ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58346/0 (socket says 172.21.15.33:58346) 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c2bcc700 1 -- 172.21.15.33:0/2277847746 learned_addr learned my addr 172.21.15.33:0/2277847746 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c1bca700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc159240 0x7ff5bc0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.822+0000 7ff5c23cb700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5bc0c6c80 0x7ff5bc1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c2bcc700 1 -- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc159240 msgr2=0x7ff5bc0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c2bcc700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc159240 0x7ff5bc0ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c2bcc700 1 -- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5bc0c6c80 msgr2=0x7ff5bc1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c2bcc700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5bc0c6c80 0x7ff5bc1450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c2bcc700 1 -- 172.21.15.33:0/2277847746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8009420 con 0x7ff5bc159610 2024-08-15T17:54:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c23cb700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5bc0c6c80 0x7ff5bc1450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c2bcc700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 0x7ff5bc0ca750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400cc90 tx=0x7ff5b4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400a960 con 0x7ff5bc159610 2024-08-15T17:54:45.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b400aac0 con 0x7ff5bc159610 2024-08-15T17:54:45.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc148350 con 0x7ff5bc159610 2024-08-15T17:54:45.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400ae80 con 0x7ff5bc159610 2024-08-15T17:54:45.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc145620 con 0x7ff5bc159610 2024-08-15T17:54:45.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc148850 con 0x7ff5bc159610 2024-08-15T17:54:45.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.826+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff5b4007300 con 0x7ff5bc159610 2024-08-15T17:54:45.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.830+0000 7ff5b27fc700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5a0060860 0x7ff5a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:45.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.830+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5b407d000 con 0x7ff5bc159610 2024-08-15T17:54:45.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.830+0000 7ff5c23cb700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5a0060860 0x7ff5a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:45.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.830+0000 7ff5c23cb700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5a0060860 0x7ff5a0062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80093f0 tx=0x7ff5b8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:45.838+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff5b404d4d0 con 0x7ff5bc159610 2024-08-15T17:54:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.038+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5bc0645c0 con 0x7ff5bc159610 2024-08-15T17:54:46.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5b27fc700 1 -- 172.21.15.33:0/2277847746 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff5b4050af0 con 0x7ff5bc159610 2024-08-15T17:54:46.043 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5a0060860 msgr2=0x7ff5a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5a0060860 0x7ff5a0062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80093f0 tx=0x7ff5b8017000 comp rx=0 tx=0).stop 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 msgr2=0x7ff5bc0ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 0x7ff5bc0ca750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400cc90 tx=0x7ff5b4001a80 comp rx=0 tx=0).stop 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 shutdown_connections 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff5a0060860 0x7ff5a0062d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5bc159610 0x7ff5bc0ca750 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5bc159240 0x7ff5bc0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 --2- 172.21.15.33:0/2277847746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5bc0c6c80 0x7ff5bc1450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 >> 172.21.15.33:0/2277847746 conn(0x7ff5bc0c9c20 msgr2=0x7ff5bc0c21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 shutdown_connections 2024-08-15T17:54:46.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:46.042+0000 7ff5c462f700 1 -- 172.21.15.33:0/2277847746 wait complete. 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-15T17:54:46.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-15T17:54:46.059 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-15T17:54:46.059 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-15T17:54:46.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:46.059 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-08-15T17:54:46.064 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:46.064 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:46.064 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:46.064 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.064 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42568sec preferred_lft 42568sec 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-08-15T17:54:46.065 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 02:42:8e:74:25:0d brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 4a:0e:25:28:ee:b4 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::c876:58ff:fea1:c236/64 scope link 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.066 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether f6:cf:c1:3a:8a:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::f4cf:c1ff:fe3a:8a9b/64 scope link 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 4a:0e:25:28:ee:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::480e:25ff:fe28:eeb4/64 scope link 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:46.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:46.067 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-15T17:54:46.121 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-08-15T17:54:46.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:46.123 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-08-15T17:54:46.132 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-08-15T17:54:46.133 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-15T17:54:46.133 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-15T17:54:46.133 INFO:teuthology.orchestra.run.smithi033.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-15T17:54:46.133 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-15T17:54:46.133 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-15T17:54:46.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:46.133 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-08-15T17:54:46.133 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-15T17:54:46.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-15T17:54:46.134 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-15T17:54:46.134 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-15T17:54:46.134 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-15T17:54:46.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:46.172 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-15T17:54:46.179 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-15T17:54:46.180 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-15T17:54:46.180 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-15T17:54:46.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:46.180 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-08-15T17:54:46.197 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-15T17:54:46.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:46.198 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:46.204 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-15T17:54:46.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:46.204 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:46.252 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:46.269 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:46.269 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:46.287 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:46.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:46.288 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:46.293 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-15T17:54:46.293 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-15T17:54:46.336 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:46.354 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:46.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:46.362 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:46.363 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:46.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:46.364 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:46.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:2024-08-15T17:54:46.422+0000 7f0ca5ae4380 -1 init, newargv = 0x557ad09216d0 newargc=15 2024-08-15T17:54:46.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[33376]: starting ceph client 2024-08-15T17:54:46.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[33376]: starting fuse 2024-08-15T17:54:47.514 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-15T17:54:47.533 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:47.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:47.545 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:47.546 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:47.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:47.547 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-15T17:54:47.554 INFO:teuthology.orchestra.run.smithi033.stdout:52 2024-08-15T17:54:47.554 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-08-15T17:54:47.555 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.0")) 2024-08-15T17:54:47.556 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-08-15T17:54:47.637 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.0.33376.asok 2024-08-15T17:54:47.823 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33376.asok 2024-08-15T17:54:47.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:47.823 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33376.asok status 2024-08-15T17:54:47.963 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:54:47.963 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-08-15T17:54:47.963 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "2c991c196a651f8ef0f36c7763ec87a241b25549", 2024-08-15T17:54:47.963 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 17.2.7-1375-g2c991c19 (2c991c196a651f8ef0f36c7763ec87a241b25549) quincy (stable)", 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "0", 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "33376", 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5181, 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 5181 2024-08-15T17:54:47.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 4056015762 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 4056015762 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.5181 192.168.0.1:0/4056015762", 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/4056015762", 2024-08-15T17:54:47.965 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2024-08-15T17:54:47.966 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 14, 2024-08-15T17:54:47.966 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 33, 2024-08-15T17:54:47.966 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-08-15T17:54:47.966 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-08-15T17:54:47.966 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-08-15T17:54:47.966 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:54:47.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:47.973 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-08-15T17:54:47.973 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:47.979 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-08-15T17:54:47.980 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:47.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:47.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-15T17:54:47.992 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-15T17:54:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 Processor -- start 2024-08-15T17:54:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 -- start start 2024-08-15T17:54:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86b806e9d0 0x7f86b806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f86b8155720 0x7f86b80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80aba70 con 0x7f86b80ab540 2024-08-15T17:54:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80abd50 con 0x7f86b806e9d0 2024-08-15T17:54:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bd528700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80ac030 con 0x7f86b8155720 2024-08-15T17:54:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86b806e9d0 0x7f86b806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86b806e9d0 0x7f86b806eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59906/0 (socket says 172.21.15.33:59906) 2024-08-15T17:54:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 -- 172.21.15.33:0/1052180110 learned_addr learned my addr 172.21.15.33:0/1052180110 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86bcd27700 1 --2- 172.21.15.33:0/1052180110 >> v2:172.21.15.105:3300/0 conn(0x7f86b8155720 0x7f86b80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 -- 172.21.15.33:0/1052180110 >> v2:172.21.15.105:3300/0 conn(0x7f86b8155720 msgr2=0x7f86b80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 --2- 172.21.15.33:0/1052180110 >> v2:172.21.15.105:3300/0 conn(0x7f86b8155720 0x7f86b80b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 -- 172.21.15.33:0/1052180110 >> v1:172.21.15.105:6789/0 conn(0x7f86b80ab540 legacy=0x7f86b8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 -- 172.21.15.33:0/1052180110 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80ac310 con 0x7f86b806e9d0 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.146+0000 7f86b7fff700 1 --2- 172.21.15.33:0/1052180110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b806e9d0 0x7f86b806eda0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f86b806b070 tx=0x7f86a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980311f30314f0b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86b6ffd700 1 -- 172.21.15.33:0/1052180110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800e070 con 0x7f86b806e9d0 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86b6ffd700 1 -- 172.21.15.33:0/1052180110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a800ba10 con 0x7f86b806e9d0 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86b6ffd700 1 -- 172.21.15.33:0/1052180110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80092e0 con 0x7f86b806e9d0 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 -- 172.21.15.33:0/1052180110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b806e9d0 msgr2=0x7f86b806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 --2- 172.21.15.33:0/1052180110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b806e9d0 0x7f86b806eda0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f86b806b070 tx=0x7f86a8009840 comp rx=0 tx=0).stop 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 -- 172.21.15.33:0/1052180110 shutdown_connections 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 --2- 172.21.15.33:0/1052180110 >> v2:172.21.15.105:3300/0 conn(0x7f86b8155720 0x7f86b80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 --2- 172.21.15.33:0/1052180110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b806e9d0 0x7f86b806eda0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 -- 172.21.15.33:0/1052180110 >> 172.21.15.33:0/1052180110 conn(0x7f86b80678d0 msgr2=0x7f86b8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 -- 172.21.15.33:0/1052180110 shutdown_connections 2024-08-15T17:54:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 -- 172.21.15.33:0/1052180110 wait complete. 2024-08-15T17:54:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 Processor -- start 2024-08-15T17:54:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.150+0000 7f86bd528700 1 -- start start 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b806e9d0 0x7f86b8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b80ab540 0x7f86b8132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 0x7f86b812fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8131420 con 0x7f86b8155720 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8143300 con 0x7f86b806e9d0 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8130810 con 0x7f86b80ab540 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 0x7f86b812fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 0x7f86b812fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59912/0 (socket says 172.21.15.33:59912) 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 -- 172.21.15.33:0/3151866649 learned_addr learned my addr 172.21.15.33:0/3151866649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86b7fff700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b806e9d0 0x7f86b8142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86b77fe700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b80ab540 0x7f86b8132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 -- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b80ab540 msgr2=0x7f86b8132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b80ab540 0x7f86b8132880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 -- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b806e9d0 msgr2=0x7f86b8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b806e9d0 0x7f86b8142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 -- 172.21.15.33:0/3151866649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8009ae0 con 0x7f86b8155720 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bcd27700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 0x7f86b812fd30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f86b000d890 tx=0x7f86b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00125f0 con 0x7f86b8155720 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0012770 con 0x7f86b8155720 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8130af0 con 0x7f86b8155720 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0012b30 con 0x7f86b8155720 2024-08-15T17:54:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b81310b0 con 0x7f86b8155720 2024-08-15T17:54:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.154+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b81315d0 con 0x7f86b8155720 2024-08-15T17:54:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.158+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f86b001e460 con 0x7f86b8155720 2024-08-15T17:54:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.158+0000 7f86affff700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8698060860 0x7f8698062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.158+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86b007d150 con 0x7f86b8155720 2024-08-15T17:54:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.158+0000 7f86b7fff700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8698060860 0x7f8698062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.158+0000 7f86b7fff700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8698060860 0x7f8698062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009880 tx=0x7f86a8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:48.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.166+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f86b004d5a0 con 0x7f86b8155720 2024-08-15T17:54:48.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.370+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86b80643a0 con 0x7f86b8155720 2024-08-15T17:54:48.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86affff700 1 -- 172.21.15.33:0/3151866649 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f86b0050bc0 con 0x7f86b8155720 2024-08-15T17:54:48.375 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-15T17:54:48.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8698060860 msgr2=0x7f8698062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8698060860 0x7f8698062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009880 tx=0x7f86a8017000 comp rx=0 tx=0).stop 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 msgr2=0x7f86b812fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 0x7f86b812fd30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f86b000d890 tx=0x7f86b0008040 comp rx=0 tx=0).stop 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 shutdown_connections 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8698060860 0x7f8698062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86b8155720 0x7f86b812fd30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86b80ab540 0x7f86b8132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 --2- 172.21.15.33:0/3151866649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86b806e9d0 0x7f86b8142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 >> 172.21.15.33:0/3151866649 conn(0x7f86b80678d0 msgr2=0x7f86b81470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 shutdown_connections 2024-08-15T17:54:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:48.374+0000 7f86bd528700 1 -- 172.21.15.33:0/3151866649 wait complete. 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-15T17:54:48.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-15T17:54:48.390 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-15T17:54:48.390 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-15T17:54:48.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:48.390 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:48.399 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42575sec preferred_lft 42575sec 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:1e:0b:9d:a0 brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-15T17:54:48.400 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 76:53:b5:12:66:7c brd ff:ff:ff:ff:ff:ff 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::e0f9:45ff:fe3e:6f59/64 scope link 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 82:e7:7b:d2:ac:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80e7:7bff:fed2:ac8d/64 scope link 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 76:53:b5:12:66:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::7453:b5ff:fe12:667c/64 scope link 2024-08-15T17:54:48.401 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-08-15T17:54:48.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:48.402 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-15T17:54:48.455 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-08-15T17:54:48.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:48.457 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-15T17:54:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-15T17:54:48.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:48.468 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2024-08-15T17:54:48.468 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-08-15T17:54:48.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-15T17:54:48.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-15T17:54:48.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-15T17:54:48.468 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-08-15T17:54:48.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:48.508 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-08-15T17:54:48.559 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-15T17:54:48.559 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-15T17:54:48.559 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-15T17:54:48.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:54:48.559 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-08-15T17:54:48.572 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-15T17:54:48.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:48.572 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:48.578 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-15T17:54:48.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-15T17:54:48.579 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:48.626 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:48.643 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:48.644 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:48.655 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:48.656 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:48.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:48.656 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:48.663 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-15T17:54:48.663 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-15T17:54:48.706 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:48.722 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:48.722 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:48.734 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:48.735 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:48.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:48.735 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:48.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:2024-08-15T17:54:48.784+0000 7fb11bdd3380 -1 init, newargv = 0x55d801ab8a70 newargc=15 2024-08-15T17:54:48.789 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[30171]: starting ceph client 2024-08-15T17:54:48.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[30171]: starting fuse 2024-08-15T17:54:49.842 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-08-15T17:54:49.860 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-15T17:54:49.860 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-15T17:54:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-15T17:54:49.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-15T17:54:49.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:49.871 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-08-15T17:54:49.878 INFO:teuthology.orchestra.run.smithi105.stdout:52 2024-08-15T17:54:49.878 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-15T17:54:49.878 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-15T17:54:49.878 DEBUG:teuthology.orchestra.run.smithi105:> import glob 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> import re 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> import subprocess 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> def _find_admin_socket(client_name): 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> files = glob.glob(asok_path) 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> # Given a non-glob path, it better be there 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> if "*" not in asok_path: 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> assert(len(files) == 1) 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> return files[0] 2024-08-15T17:54:49.879 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> for f in files: 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> contents = proc_f.read() 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> if mountpoint in contents: 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> return f 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> print(_find_admin_socket("client.1")) 2024-08-15T17:54:49.880 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-08-15T17:54:50.007 INFO:teuthology.orchestra.run.smithi105.stdout:/var/run/ceph/ceph-client.1.30171.asok 2024-08-15T17:54:50.191 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30171.asok 2024-08-15T17:54:50.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:50.191 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30171.asok status 2024-08-15T17:54:50.289 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "metadata": { 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_sha1": "2c991c196a651f8ef0f36c7763ec87a241b25549", 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 17.2.7-1375-g2c991c19 (2c991c196a651f8ef0f36c7763ec87a241b25549) quincy (stable)", 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "entity_id": "1", 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "hostname": "smithi105", 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "pid": "30171", 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "root": "/" 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:50.290 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_count": 0, 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_pinned_count": 0, 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 5203, 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "inst": { 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "name": { 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 5203 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 2728721987 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:50.291 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 2728721987 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "inst_str": "client.5203 192.168.0.1:0/2728721987", 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "addr_str": "192.168.0.1:0/2728721987", 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "inode_count": 1, 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_epoch": 14, 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch": 33, 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch_barrier": 0, 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "blocklisted": false, 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs" 2024-08-15T17:54:50.292 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-08-15T17:54:50.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:50.299 DEBUG:teuthology.orchestra.run.smithi105:> stat --file-system '--printf=%T 2024-08-15T17:54:50.299 DEBUG:teuthology.orchestra.run.smithi105:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:50.307 INFO:teuthology.orchestra.run.smithi105.stdout:fuseblk 2024-08-15T17:54:50.307 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:50.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-15T17:54:50.307 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-15T17:54:50.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-15T17:54:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.430+0000 7f4a886b8700 1 Processor -- start 2024-08-15T17:54:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.430+0000 7f4a886b8700 1 -- start start 2024-08-15T17:54:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4a8015a6a0 0x7f4a800686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8006ea10 0x7f4a80068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8006c2f0 con 0x7f4a800ae910 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a800ca6b0 con 0x7f4a8015a6a0 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8006ba50 con 0x7f4a8006ea10 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86454700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4a8015a6a0 0x7f4a800686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86c55700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4a800ae910 0x7f4a800699a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43814/0 (socket says 172.21.15.33:43814) 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86c55700 1 -- 172.21.15.33:0/3640013341 learned_addr learned my addr 172.21.15.33:0/3640013341 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a85c53700 1 --2- 172.21.15.33:0/3640013341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8006ea10 0x7f4a80068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a85452700 1 -- 172.21.15.33:0/3640013341 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431266502 0 0) 0x7f4a8006c2f0 con 0x7f4a800ae910 2024-08-15T17:54:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a85452700 1 -- 172.21.15.33:0/3640013341 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c003570 con 0x7f4a800ae910 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86454700 1 -- 172.21.15.33:0/3640013341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8006ea10 msgr2=0x7f4a80068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86454700 1 --2- 172.21.15.33:0/3640013341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8006ea10 0x7f4a80068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86454700 1 -- 172.21.15.33:0/3640013341 >> v1:172.21.15.33:6789/0 conn(0x7f4a800ae910 legacy=0x7f4a800699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86454700 1 -- 172.21.15.33:0/3640013341 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8006bd30 con 0x7f4a8015a6a0 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a86454700 1 --2- 172.21.15.33:0/3640013341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a8015a6a0 0x7f4a800686a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0098e0 tx=0x7f4a7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31269615f3f55a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a85452700 1 -- 172.21.15.33:0/3640013341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00b640 con 0x7f4a8015a6a0 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a85452700 1 -- 172.21.15.33:0/3640013341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c00b7a0 con 0x7f4a8015a6a0 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a85452700 1 -- 172.21.15.33:0/3640013341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00bb40 con 0x7f4a8015a6a0 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- 172.21.15.33:0/3640013341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a8015a6a0 msgr2=0x7f4a800686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 --2- 172.21.15.33:0/3640013341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a8015a6a0 0x7f4a800686a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0098e0 tx=0x7f4a7c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- 172.21.15.33:0/3640013341 shutdown_connections 2024-08-15T17:54:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 --2- 172.21.15.33:0/3640013341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8006ea10 0x7f4a80068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 --2- 172.21.15.33:0/3640013341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a8015a6a0 0x7f4a800686a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- 172.21.15.33:0/3640013341 >> 172.21.15.33:0/3640013341 conn(0x7f4a8006d9f0 msgr2=0x7f4a8006ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- 172.21.15.33:0/3640013341 shutdown_connections 2024-08-15T17:54:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- 172.21.15.33:0/3640013341 wait complete. 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 Processor -- start 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.434+0000 7f4a886b8700 1 -- start start 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a8006ea10 0x7f4a801441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 0x7f4a8015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8015a6a0 0x7f4a8015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80167f90 con 0x7f4a800ae910 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a801446e0 con 0x7f4a8006ea10 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80167410 con 0x7f4a8015a6a0 2024-08-15T17:54:50.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 0x7f4a8015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 0x7f4a8015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59922/0 (socket says 172.21.15.33:59922) 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 -- 172.21.15.33:0/2214672187 learned_addr learned my addr 172.21.15.33:0/2214672187 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a86454700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a8006ea10 0x7f4a801441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a86c55700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8015a6a0 0x7f4a8015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 -- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8015a6a0 msgr2=0x7f4a8015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8015a6a0 0x7f4a8015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 -- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a8006ea10 msgr2=0x7f4a801441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a8006ea10 0x7f4a801441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 -- 172.21.15.33:0/2214672187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c009420 con 0x7f4a800ae910 2024-08-15T17:54:50.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a86454700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a8006ea10 0x7f4a801441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a85c53700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 0x7f4a8015b660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000d860 tx=0x7f4a70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70009610 con 0x7f4a800ae910 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70009770 con 0x7f4a800ae910 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a801676f0 con 0x7f4a800ae910 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70009b30 con 0x7f4a800ae910 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80167cb0 con 0x7f4a800ae910 2024-08-15T17:54:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.438+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a800638f0 con 0x7f4a800ae910 2024-08-15T17:54:50.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.442+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4a7001e460 con 0x7f4a800ae910 2024-08-15T17:54:50.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.442+0000 7f4a767fc700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4a64060860 0x7f4a64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:50.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.442+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a7007d1f0 con 0x7f4a800ae910 2024-08-15T17:54:50.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.442+0000 7f4a86454700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4a64060860 0x7f4a64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:50.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.442+0000 7f4a86454700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4a64060860 0x7f4a64062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0093f0 tx=0x7f4a7c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.450+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4a7004d640 con 0x7f4a800ae910 2024-08-15T17:54:50.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:50.650+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a800cad90 con 0x7f4a800ae910 2024-08-15T17:54:51.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.322+0000 7f4a767fc700 1 -- 172.21.15.33:0/2214672187 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4a70050c60 con 0x7f4a800ae910 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4a64060860 msgr2=0x7f4a64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4a64060860 0x7f4a64062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0093f0 tx=0x7f4a7c017000 comp rx=0 tx=0).stop 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 msgr2=0x7f4a8015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 0x7f4a8015b660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000d860 tx=0x7f4a70008040 comp rx=0 tx=0).stop 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 shutdown_connections 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4a64060860 0x7f4a64062d10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a8015a6a0 0x7f4a8015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800ae910 0x7f4a8015b660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 --2- 172.21.15.33:0/2214672187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a8006ea10 0x7f4a801441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 >> 172.21.15.33:0/2214672187 conn(0x7f4a8006d9f0 msgr2=0x7f4a800b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 shutdown_connections 2024-08-15T17:54:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.330+0000 7f4a886b8700 1 -- 172.21.15.33:0/2214672187 wait complete. 2024-08-15T17:54:51.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-15T17:54:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 Processor -- start 2024-08-15T17:54:51.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 -- start start 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f281c159340 0x7f281c159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f281c0b4160 0x7f281c0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0b45e0 con 0x7f281c0b4160 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0b1cf0 con 0x7f281c159340 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2823537700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0b60d0 con 0x7f281c159c50 2024-08-15T17:54:51.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2821ad4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f281c0b4160 0x7f281c0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2821ad4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f281c0b4160 0x7f281c0b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59934/0 (socket says 172.21.15.33:59934) 2024-08-15T17:54:51.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2821ad4700 1 -- 172.21.15.33:0/2087383041 learned_addr learned my addr 172.21.15.33:0/2087383041 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:51.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f28212d3700 1 --2- 172.21.15.33:0/2087383041 >> v2:172.21.15.105:3300/0 conn(0x7f281c159340 0x7f281c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.458+0000 7f2820ad2700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2821ad4700 1 -- 172.21.15.33:0/2087383041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 msgr2=0x7f281c0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:51.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2821ad4700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c0b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2821ad4700 1 -- 172.21.15.33:0/2087383041 >> v2:172.21.15.105:3300/0 conn(0x7f281c159340 msgr2=0x7f281c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2821ad4700 1 --2- 172.21.15.33:0/2087383041 >> v2:172.21.15.105:3300/0 conn(0x7f281c159340 0x7f281c159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2821ad4700 1 -- 172.21.15.33:0/2087383041 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0b10e0 con 0x7f281c0b4160 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2820ad2700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2821ad4700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c0b04e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f281c064990 tx=0x7f2814009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289662172faacc94 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f280ffff700 1 -- 172.21.15.33:0/2087383041 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400e070 con 0x7f281c0b4160 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f280ffff700 1 -- 172.21.15.33:0/2087383041 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400b970 con 0x7f281c0b4160 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f280ffff700 1 -- 172.21.15.33:0/2087383041 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140092e0 con 0x7f281c0b4160 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 -- 172.21.15.33:0/2087383041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 msgr2=0x7f281c0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c0b04e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f281c064990 tx=0x7f2814009840 comp rx=0 tx=0).stop 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 -- 172.21.15.33:0/2087383041 shutdown_connections 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c0b04e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 --2- 172.21.15.33:0/2087383041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 --2- 172.21.15.33:0/2087383041 >> v2:172.21.15.105:3300/0 conn(0x7f281c159340 0x7f281c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 -- 172.21.15.33:0/2087383041 >> 172.21.15.33:0/2087383041 conn(0x7f281c0994f0 msgr2=0x7f281c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 -- 172.21.15.33:0/2087383041 shutdown_connections 2024-08-15T17:54:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 -- 172.21.15.33:0/2087383041 wait complete. 2024-08-15T17:54:51.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 Processor -- start 2024-08-15T17:54:51.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.462+0000 7f2823537700 1 -- start start 2024-08-15T17:54:51.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f281c159340 0x7f281c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c09b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c15ebe0 con 0x7f281c0b4160 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c14dd20 con 0x7f281c159340 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c15dfd0 con 0x7f281c159c50 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c14d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59950/0 (socket says 172.21.15.33:59950) 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 -- 172.21.15.33:0/1515310247 learned_addr learned my addr 172.21.15.33:0/1515310247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2820ad2700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f281c159340 0x7f281c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2821ad4700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c09b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 -- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 msgr2=0x7f281c09b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c09b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 -- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f281c159340 msgr2=0x7f281c1565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f281c159340 0x7f281c1565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 -- 172.21.15.33:0/1515310247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818009420 con 0x7f281c0b4160 2024-08-15T17:54:51.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f28212d3700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c14d7e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f281000ecb0 tx=0x7f28100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000c850 con 0x7f281c0b4160 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000c9b0 con 0x7f281c0b4160 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2814009ae0 con 0x7f281c0b4160 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000cd50 con 0x7f281c0b4160 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c15e590 con 0x7f281c0b4160 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.466+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c0645c0 con 0x7f281c0b4160 2024-08-15T17:54:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.470+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2810013680 con 0x7f281c0b4160 2024-08-15T17:54:51.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.470+0000 7f280d7fa700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2800060860 0x7f2800062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.470+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f281007cec0 con 0x7f281c0b4160 2024-08-15T17:54:51.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.470+0000 7f2820ad2700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2800060860 0x7f2800062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.470+0000 7f2820ad2700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2800060860 0x7f2800062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f281c1563e0 tx=0x7f28180091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.478+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f281004d270 con 0x7f281c0b4160 2024-08-15T17:54:51.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.666+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f281c0b4760 con 0x7f2800060860 2024-08-15T17:54:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f280d7fa700 1 -- 172.21.15.33:0/1515310247 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f281c0b4760 con 0x7f2800060860 2024-08-15T17:54:51.672 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-08-15T17:54:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2024-08-15T17:54:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:51.672 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-08-15T17:54:51.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2800060860 msgr2=0x7f2800062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2800060860 0x7f2800062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f281c1563e0 tx=0x7f28180091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 msgr2=0x7f281c14d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c14d7e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f281000ecb0 tx=0x7f28100091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 shutdown_connections 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2800060860 0x7f2800062d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f281c159340 0x7f281c1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f281c159c50 0x7f281c09b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 --2- 172.21.15.33:0/1515310247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f281c0b4160 0x7f281c14d7e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 >> 172.21.15.33:0/1515310247 conn(0x7f281c0994f0 msgr2=0x7f281c0aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 shutdown_connections 2024-08-15T17:54:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.674+0000 7f2823537700 1 -- 172.21.15.33:0/1515310247 wait complete. 2024-08-15T17:54:51.686 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-15T17:54:51.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 Processor -- start 2024-08-15T17:54:51.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 -- start start 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f163c156ce0 0x7f163c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f163c1570b0 0x7f163c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163c15d7d0 con 0x7f163c15d3d0 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c0cc020 con 0x7f163c156ce0 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f1641cf0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c0c38c0 con 0x7f163c1570b0 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f163c15d3d0 0x7f163c142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43830/0 (socket says 172.21.15.33:43830) 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163bfff700 1 -- 172.21.15.33:0/3465910072 learned_addr learned my addr 172.21.15.33:0/3465910072 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f163c156ce0 0x7f163c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163affd700 1 --2- 172.21.15.33:0/3465910072 >> v2:172.21.15.105:3300/0 conn(0x7f163c1570b0 0x7f163c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455823643 0 0) 0x7f163c15d7d0 con 0x7f163c15d3d0 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1624003570 con 0x7f163c15d3d0 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371703648 0 0) 0x7f1624003570 con 0x7f163c15d3d0 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 >> v2:172.21.15.105:3300/0 conn(0x7f163c1570b0 msgr2=0x7f163c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 --2- 172.21.15.33:0/3465910072 >> v2:172.21.15.105:3300/0 conn(0x7f163c1570b0 0x7f163c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 >> v2:172.21.15.33:3300/0 conn(0x7f163c156ce0 msgr2=0x7f163c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 --2- 172.21.15.33:0/3465910072 >> v2:172.21.15.33:3300/0 conn(0x7f163c156ce0 0x7f163c0cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0c3ba0 con 0x7f163c15d3d0 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f16340017f0 con 0x7f163c15d3d0 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 >> v1:172.21.15.33:6789/0 conn(0x7f163c15d3d0 legacy=0x7f163c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1624003a60 0x7f1624003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624004810 0x7f1624004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16240051c0 0x7f162400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0cc020 con 0x7f1624003a60 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c38c0 con 0x7f16240051c0 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162400bfd0 con 0x7f1624004810 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1624003a60 0x7f1624003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163bfff700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16240051c0 0x7f162400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163affd700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624004810 0x7f1624004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 -- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624004810 msgr2=0x7f1624004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624004810 0x7f1624004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 -- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16240051c0 msgr2=0x7f162400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16240051c0 0x7f162400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163bfff700 1 -- 172.21.15.33:0/3465910072 reap_dead start 2024-08-15T17:54:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.798+0000 7f163b7fe700 1 -- 172.21.15.33:0/3465910072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624003570 con 0x7f1624003a60 2024-08-15T17:54:51.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1624003a60 0x7f1624003e70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f162c006f00 tx=0x7f162c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2247d922ad1ccb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:51.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00e6b0 con 0x7f1624003a60 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c00e810 con 0x7f1624003a60 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163a7fc700 1 -- 172.21.15.33:0/3465910072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00ebd0 con 0x7f1624003a60 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- 172.21.15.33:0/3465910072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1624003a60 msgr2=0x7f1624003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1624003a60 0x7f1624003e70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f162c006f00 tx=0x7f162c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- 172.21.15.33:0/3465910072 shutdown_connections 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3465910072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1624003a60 0x7f1624003e70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- 172.21.15.33:0/3465910072 >> 172.21.15.33:0/3465910072 conn(0x7f163c0caae0 msgr2=0x7f163c0caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- 172.21.15.33:0/3465910072 shutdown_connections 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- 172.21.15.33:0/3465910072 wait complete. 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 Processor -- start 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- start start 2024-08-15T17:54:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624003a60 0x7f163c0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 0x7f163c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f163c1545c0 0x7f163c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c7ca0 con 0x7f163c0b29c0 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c154f70 con 0x7f163c1545c0 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f1641cf0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0b18a0 con 0x7f1624003a60 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 0x7f163c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 0x7f163c1532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59968/0 (socket says 172.21.15.33:59968) 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 -- 172.21.15.33:0/3833785886 learned_addr learned my addr 172.21.15.33:0/3833785886 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163bfff700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f163c1545c0 0x7f163c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624003a60 0x7f163c0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 -- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624003a60 msgr2=0x7f163c0c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624003a60 0x7f163c0c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 -- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f163c1545c0 msgr2=0x7f163c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f163c1545c0 0x7f163c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.802+0000 7f163affd700 1 -- 172.21.15.33:0/3833785886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0b2e30 con 0x7f163c0b29c0 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f163affd700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 0x7f163c1532c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1630011da0 tx=0x7f16300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000fa10 con 0x7f163c0b29c0 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163000fb70 con 0x7f163c0b29c0 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c15a460 con 0x7f163c0b29c0 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630014440 con 0x7f163c0b29c0 2024-08-15T17:54:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c0b1d30 con 0x7f163c0b29c0 2024-08-15T17:54:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c0645c0 con 0x7f163c0b29c0 2024-08-15T17:54:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1630014870 con 0x7f163c0b29c0 2024-08-15T17:54:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.806+0000 7f16237fe700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1628060890 0x7f1628062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.810+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1630018030 con 0x7f163c0b29c0 2024-08-15T17:54:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.810+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1628060890 0x7f1628062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.810+0000 7f163b7fe700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1628060890 0x7f1628062d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f162c0091e0 tx=0x7f162c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.814+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f163004d990 con 0x7f163c0b29c0 2024-08-15T17:54:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.978+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f163c0b19e0 con 0x7f163c0b29c0 2024-08-15T17:54:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f16237fe700 1 -- 172.21.15.33:0/3833785886 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1630050fb0 con 0x7f163c0b29c0 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1628060890 msgr2=0x7f1628062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1628060890 0x7f1628062d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f162c0091e0 tx=0x7f162c01a000 comp rx=0 tx=0).stop 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 msgr2=0x7f163c1532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 0x7f163c1532c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1630011da0 tx=0x7f16300091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 shutdown_connections 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1628060890 0x7f1628062d40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f163c1545c0 0x7f163c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f163c0b29c0 0x7f163c1532c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 --2- 172.21.15.33:0/3833785886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1624003a60 0x7f163c0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 >> 172.21.15.33:0/3833785886 conn(0x7f163c0caae0 msgr2=0x7f163c0c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 shutdown_connections 2024-08-15T17:54:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:51.982+0000 7f1641cf0700 1 -- 172.21.15.33:0/3833785886 wait complete. 2024-08-15T17:54:51.997 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000657299 2024-08-15T17:54:52.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 Processor -- start 2024-08-15T17:54:52.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 -- start start 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab6c1597d0 0x7fab6c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 0x7fab6c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0adb00 con 0x7fab6c159400 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c06bf60 con 0x7fab6c1597d0 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab73815700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0ac630 con 0x7fab6c06bac0 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab71db2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 0x7fab6c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab71db2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 0x7fab6c0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:50092/0 (socket says 172.21.15.33:50092) 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab71db2700 1 -- 172.21.15.33:0/1252258015 learned_addr learned my addr 172.21.15.33:0/1252258015 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.110+0000 7fab70db0700 1 --2- 172.21.15.33:0/1252258015 >> v2:172.21.15.105:3300/0 conn(0x7fab6c1597d0 0x7fab6c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:52.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab71db2700 1 -- 172.21.15.33:0/1252258015 >> v2:172.21.15.105:3300/0 conn(0x7fab6c1597d0 msgr2=0x7fab6c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:52.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab71db2700 1 --2- 172.21.15.33:0/1252258015 >> v2:172.21.15.105:3300/0 conn(0x7fab6c1597d0 0x7fab6c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:52.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab71db2700 1 -- 172.21.15.33:0/1252258015 >> v1:172.21.15.105:6789/0 conn(0x7fab6c159400 legacy=0x7fab6c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:52.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab71db2700 1 -- 172.21.15.33:0/1252258015 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0ac910 con 0x7fab6c06bac0 2024-08-15T17:54:52.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab71db2700 1 --2- 172.21.15.33:0/1252258015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 0x7fab6c0686a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab64009f20 tx=0x7fab64009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc75c04abb79701 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:52.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab63fff700 1 -- 172.21.15.33:0/1252258015 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400e070 con 0x7fab6c06bac0 2024-08-15T17:54:52.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab63fff700 1 -- 172.21.15.33:0/1252258015 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400b9d0 con 0x7fab6c06bac0 2024-08-15T17:54:52.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab63fff700 1 -- 172.21.15.33:0/1252258015 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640092e0 con 0x7fab6c06bac0 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 -- 172.21.15.33:0/1252258015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 msgr2=0x7fab6c0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 --2- 172.21.15.33:0/1252258015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 0x7fab6c0686a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab64009f20 tx=0x7fab64009840 comp rx=0 tx=0).stop 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 -- 172.21.15.33:0/1252258015 shutdown_connections 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 --2- 172.21.15.33:0/1252258015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c06bac0 0x7fab6c0686a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 --2- 172.21.15.33:0/1252258015 >> v2:172.21.15.105:3300/0 conn(0x7fab6c1597d0 0x7fab6c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 -- 172.21.15.33:0/1252258015 >> 172.21.15.33:0/1252258015 conn(0x7fab6c0c9bf0 msgr2=0x7fab6c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 -- 172.21.15.33:0/1252258015 shutdown_connections 2024-08-15T17:54:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.114+0000 7fab73815700 1 -- 172.21.15.33:0/1252258015 wait complete. 2024-08-15T17:54:52.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 Processor -- start 2024-08-15T17:54:52.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 -- start start 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 0x7fab6c165da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c159400 0x7fab6c0c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab6c1597d0 0x7fab6c0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0ab380 con 0x7fab6c06bac0 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0a76b0 con 0x7fab6c1597d0 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab73815700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0a7990 con 0x7fab6c159400 2024-08-15T17:54:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab715b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 0x7fab6c165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab715b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 0x7fab6c165da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59974/0 (socket says 172.21.15.33:59974) 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab715b1700 1 -- 172.21.15.33:0/1349847644 learned_addr learned my addr 172.21.15.33:0/1349847644 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab70db0700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c159400 0x7fab6c0c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.118+0000 7fab71db2700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab6c1597d0 0x7fab6c0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab715b1700 1 -- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c159400 msgr2=0x7fab6c0c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab715b1700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c159400 0x7fab6c0c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab715b1700 1 -- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab6c1597d0 msgr2=0x7fab6c0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab715b1700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab6c1597d0 0x7fab6c0aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab715b1700 1 -- 172.21.15.33:0/1349847644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64009ae0 con 0x7fab6c06bac0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab715b1700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 0x7fab6c165da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c590 tx=0x7fab6800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68011590 con 0x7fab6c06bac0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68011710 con 0x7fab6c06bac0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c0a7c70 con 0x7fab6c06bac0 2024-08-15T17:54:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68011ad0 con 0x7fab6c06bac0 2024-08-15T17:54:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c0a9ba0 con 0x7fab6c06bac0 2024-08-15T17:54:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c0645c0 con 0x7fab6c06bac0 2024-08-15T17:54:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fab6801b3b0 con 0x7fab6c06bac0 2024-08-15T17:54:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab617fa700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fab50060860 0x7fab50062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:52.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab6807c090 con 0x7fab6c06bac0 2024-08-15T17:54:52.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.122+0000 7fab70db0700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fab50060860 0x7fab50062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.126+0000 7fab70db0700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fab50060860 0x7fab50062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0c1bf0 tx=0x7fab5c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.130+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fab6804c4e0 con 0x7fab6c06bac0 2024-08-15T17:54:52.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:52.322+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000657299", "target": ["mon-mgr", ""]}) v1 -- 0x7fab6c067c60 con 0x7fab50060860 2024-08-15T17:54:53.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:54:53.147 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:54:55.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.394+0000 7fab617fa700 1 -- 172.21.15.33:0/1349847644 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fab6c067c60 con 0x7fab50060860 2024-08-15T17:54:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fab50060860 msgr2=0x7fab50062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fab50060860 0x7fab50062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0c1bf0 tx=0x7fab5c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 msgr2=0x7fab6c165da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 0x7fab6c165da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c590 tx=0x7fab6800c8a0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 shutdown_connections 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fab50060860 0x7fab50062d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab6c1597d0 0x7fab6c0aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab6c159400 0x7fab6c0c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 --2- 172.21.15.33:0/1349847644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab6c06bac0 0x7fab6c165da0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 >> 172.21.15.33:0/1349847644 conn(0x7fab6c0c9bf0 msgr2=0x7fab6c0ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 shutdown_connections 2024-08-15T17:54:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.398+0000 7fab73815700 1 -- 172.21.15.33:0/1349847644 wait complete. 2024-08-15T17:54:55.402 INFO:teuthology.orchestra.run.smithi033.stderr:Volume created successfully (no MDS daemons created) 2024-08-15T17:54:55.413 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-15T17:54:55.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 Processor -- start 2024-08-15T17:54:55.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 -- start start 2024-08-15T17:54:55.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d5806e620 0x7f2d580b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d580b1630 0x7f2d58141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d58141a00 con 0x7f2d580b0d20 2024-08-15T17:54:55.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d58140b10 con 0x7f2d580b1630 2024-08-15T17:54:55.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5eca9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58140df0 con 0x7f2d5806e620 2024-08-15T17:54:55.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d580b1630 0x7f2d58141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d580b1630 0x7f2d58141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59990/0 (socket says 172.21.15.33:59990) 2024-08-15T17:54:55.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/3650894810 learned_addr learned my addr 172.21.15.33:0/3650894810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:55.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5d4a6700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d5806e620 0x7f2d580b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/3650894810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d5806e620 msgr2=0x7f2d580b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:55.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d5806e620 0x7f2d580b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/3650894810 >> v1:172.21.15.105:6789/0 conn(0x7f2d580b0d20 legacy=0x7f2d5806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/3650894810 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d581410d0 con 0x7f2d580b1630 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5d4a6700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d5806e620 0x7f2d580b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5e4a8700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58141e90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009f20 tx=0x7f2d50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22774f1503f6486 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.518+0000 7f2d5cca5700 1 -- 172.21.15.33:0/3650894810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000e070 con 0x7f2d580b1630 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5cca5700 1 -- 172.21.15.33:0/3650894810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000ba80 con 0x7f2d580b1630 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5cca5700 1 -- 172.21.15.33:0/3650894810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500092e0 con 0x7f2d580b1630 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 -- 172.21.15.33:0/3650894810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 msgr2=0x7f2d58141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58141e90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009f20 tx=0x7f2d50009840 comp rx=0 tx=0).stop 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 -- 172.21.15.33:0/3650894810 shutdown_connections 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58141e90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/3650894810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d5806e620 0x7f2d580b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 -- 172.21.15.33:0/3650894810 >> 172.21.15.33:0/3650894810 conn(0x7f2d580678d0 msgr2=0x7f2d58067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:55.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 -- 172.21.15.33:0/3650894810 shutdown_connections 2024-08-15T17:54:55.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 -- 172.21.15.33:0/3650894810 wait complete. 2024-08-15T17:54:55.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 Processor -- start 2024-08-15T17:54:55.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.522+0000 7f2d5eca9700 1 -- start start 2024-08-15T17:54:55.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d5806e620 0x7f2d580ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d580b0d20 0x7f2d58170860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58143c20 con 0x7f2d580b1630 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58143f00 con 0x7f2d5806e620 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580ae3a0 con 0x7f2d580b0d20 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59994/0 (socket says 172.21.15.33:59994) 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/2406340172 learned_addr learned my addr 172.21.15.33:0/2406340172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5dca7700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d5806e620 0x7f2d580ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5d4a6700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d580b0d20 0x7f2d58170860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d580b0d20 msgr2=0x7f2d58170860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d580b0d20 0x7f2d58170860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d5806e620 msgr2=0x7f2d580ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d5806e620 0x7f2d580ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 -- 172.21.15.33:0/2406340172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009ae0 con 0x7f2d580b1630 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5d4a6700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d580b0d20 0x7f2d58170860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5e4a8700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58144390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2d50003400 tx=0x7f2d50018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50008e70 con 0x7f2d580b1630 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50026460 con 0x7f2d580b1630 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d58171090 con 0x7f2d580b1630 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50026820 con 0x7f2d580b1630 2024-08-15T17:54:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d58171650 con 0x7f2d580b1630 2024-08-15T17:54:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d58144090 con 0x7f2d580b1630 2024-08-15T17:54:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2d50003040 con 0x7f2d580b1630 2024-08-15T17:54:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d4dffb700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d3c060860 0x7f2d3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.526+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2d5007f170 con 0x7f2d580b1630 2024-08-15T17:54:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.530+0000 7f2d5dca7700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d3c060860 0x7f2d3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.530+0000 7f2d5dca7700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d3c060860 0x7f2d3c062d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d54003860 tx=0x7f2d54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:55.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.538+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2d5004f240 con 0x7f2d580b1630 2024-08-15T17:54:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.722+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d580643a0 con 0x7f2d3c060860 2024-08-15T17:54:55.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.726+0000 7f2d4dffb700 1 -- 172.21.15.33:0/2406340172 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f2d580643a0 con 0x7f2d3c060860 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000657299" 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-15T17:54:55.730 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-08-15T17:54:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d3c060860 msgr2=0x7f2d3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d3c060860 0x7f2d3c062d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d54003860 tx=0x7f2d54009040 comp rx=0 tx=0).stop 2024-08-15T17:54:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 msgr2=0x7f2d58144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58144390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2d50003400 tx=0x7f2d50018000 comp rx=0 tx=0).stop 2024-08-15T17:54:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 shutdown_connections 2024-08-15T17:54:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d3c060860 0x7f2d3c062d10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d580b1630 0x7f2d58144390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d580b0d20 0x7f2d58170860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 --2- 172.21.15.33:0/2406340172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d5806e620 0x7f2d580ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 >> 172.21.15.33:0/2406340172 conn(0x7f2d580678d0 msgr2=0x7f2d5806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 shutdown_connections 2024-08-15T17:54:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.730+0000 7f2d5eca9700 1 -- 172.21.15.33:0/2406340172 wait complete. 2024-08-15T17:54:55.745 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-15T17:54:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.854+0000 7f736547a700 1 Processor -- start 2024-08-15T17:54:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.854+0000 7f736547a700 1 -- start start 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73601514d0 0x7f736006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73600b14a0 0x7f7360157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736006e010 con 0x7f73601574f0 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736006efa0 con 0x7f73601514d0 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360157fb0 con 0x7f73600b14a0 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f73601574f0 0x7f73600b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43838/0 (socket says 172.21.15.33:43838) 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735f7fe700 1 -- 172.21.15.33:0/1821194315 learned_addr learned my addr 172.21.15.33:0/1821194315 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f7364c79700 1 --2- 172.21.15.33:0/1821194315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73600b14a0 0x7f7360157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735ffff700 1 --2- 172.21.15.33:0/1821194315 >> v2:172.21.15.105:3300/0 conn(0x7f73601514d0 0x7f736006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735effd700 1 -- 172.21.15.33:0/1821194315 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031484202 0 0) 0x7f736006e010 con 0x7f73601574f0 2024-08-15T17:54:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735effd700 1 -- 172.21.15.33:0/1821194315 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003570 con 0x7f73601574f0 2024-08-15T17:54:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f7364c79700 1 -- 172.21.15.33:0/1821194315 >> v2:172.21.15.105:3300/0 conn(0x7f73601514d0 msgr2=0x7f736006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f7364c79700 1 --2- 172.21.15.33:0/1821194315 >> v2:172.21.15.105:3300/0 conn(0x7f73601514d0 0x7f736006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f7364c79700 1 -- 172.21.15.33:0/1821194315 >> v1:172.21.15.33:6789/0 conn(0x7f73601574f0 legacy=0x7f73600b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f7364c79700 1 -- 172.21.15.33:0/1821194315 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360158290 con 0x7f73600b14a0 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f7364c79700 1 --2- 172.21.15.33:0/1821194315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73600b14a0 0x7f7360157990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7358009e60 tx=0x7f7358009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5125ce0ecd60972c server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735effd700 1 -- 172.21.15.33:0/1821194315 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800e070 con 0x7f73600b14a0 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735effd700 1 -- 172.21.15.33:0/1821194315 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800bab0 con 0x7f73600b14a0 2024-08-15T17:54:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f735effd700 1 -- 172.21.15.33:0/1821194315 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800be30 con 0x7f73600b14a0 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- 172.21.15.33:0/1821194315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73600b14a0 msgr2=0x7f7360157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 --2- 172.21.15.33:0/1821194315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73600b14a0 0x7f7360157990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7358009e60 tx=0x7f7358009780 comp rx=0 tx=0).stop 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- 172.21.15.33:0/1821194315 shutdown_connections 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 --2- 172.21.15.33:0/1821194315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73600b14a0 0x7f7360157990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 --2- 172.21.15.33:0/1821194315 >> v2:172.21.15.105:3300/0 conn(0x7f73601514d0 0x7f736006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- 172.21.15.33:0/1821194315 >> 172.21.15.33:0/1821194315 conn(0x7f73600678a0 msgr2=0x7f7360067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- 172.21.15.33:0/1821194315 shutdown_connections 2024-08-15T17:54:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.858+0000 7f736547a700 1 -- 172.21.15.33:0/1821194315 wait complete. 2024-08-15T17:54:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 Processor -- start 2024-08-15T17:54:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 -- start start 2024-08-15T17:54:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 0x7f7360140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73601514d0 0x7f7360155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73601574f0 0x7f7360069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7360141510 con 0x7f73600b14a0 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7360140b40 con 0x7f73601574f0 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f736547a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736013ff30 con 0x7f73601514d0 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 0x7f7360140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 0x7f7360140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59998/0 (socket says 172.21.15.33:59998) 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735f7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73601514d0 0x7f7360155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f7364c79700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73601574f0 0x7f7360069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 -- 172.21.15.33:0/1356578108 learned_addr learned my addr 172.21.15.33:0/1356578108 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 -- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73601514d0 msgr2=0x7f7360155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73601514d0 0x7f7360155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 -- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73601574f0 msgr2=0x7f7360069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73601574f0 0x7f7360069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.862+0000 7f735ffff700 1 -- 172.21.15.33:0/1356578108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358009a20 con 0x7f73600b14a0 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f735ffff700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 0x7f7360140fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f735000ecb0 tx=0x7f73500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000c8e0 con 0x7f73600b14a0 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735000ca40 con 0x7f73600b14a0 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360140210 con 0x7f73600b14a0 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000cde0 con 0x7f73600b14a0 2024-08-15T17:54:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73601407d0 con 0x7f73600b14a0 2024-08-15T17:54:55.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.866+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360064330 con 0x7f73600b14a0 2024-08-15T17:54:55.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.870+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7350013680 con 0x7f73600b14a0 2024-08-15T17:54:55.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.870+0000 7f7357fff700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7344060860 0x7f7344062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:55.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.870+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f735007d910 con 0x7f73600b14a0 2024-08-15T17:54:55.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.870+0000 7f735f7fe700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7344060860 0x7f7344062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:55.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.870+0000 7f735f7fe700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7344060860 0x7f7344062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73600cacf0 tx=0x7f7348009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:55.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:55.874+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f735004da60 con 0x7f73600b14a0 2024-08-15T17:54:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.042+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f736006ea00 con 0x7f73600b14a0 2024-08-15T17:54:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f7357fff700 1 -- 172.21.15.33:0/1356578108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f7350051080 con 0x7f73600b14a0 2024-08-15T17:54:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7344060860 msgr2=0x7f7344062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7344060860 0x7f7344062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73600cacf0 tx=0x7f7348009040 comp rx=0 tx=0).stop 2024-08-15T17:54:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 msgr2=0x7f7360140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 0x7f7360140fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f735000ecb0 tx=0x7f73500091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 shutdown_connections 2024-08-15T17:54:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7344060860 0x7f7344062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73601574f0 0x7f7360069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73601514d0 0x7f7360155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 --2- 172.21.15.33:0/1356578108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73600b14a0 0x7f7360140fd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 >> 172.21.15.33:0/1356578108 conn(0x7f73600678a0 msgr2=0x7f73600b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 shutdown_connections 2024-08-15T17:54:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.046+0000 7f736547a700 1 -- 172.21.15.33:0/1356578108 wait complete. 2024-08-15T17:54:56.062 INFO:teuthology.orchestra.run.smithi033.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}] 2024-08-15T17:54:56.062 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000657299 --format=json 2024-08-15T17:54:56.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.174+0000 7fa09b00d700 1 Processor -- start 2024-08-15T17:54:56.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.174+0000 7fa09b00d700 1 -- start start 2024-08-15T17:54:56.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159570 0x7fa0940b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa0940b3d20 0x7fa0940b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0940b0fc0 con 0x7fa094159940 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940b1860 con 0x7fa0940b3d20 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940b4700 con 0x7fa094159570 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa093fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa094159940 0x7fa0940b0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43840/0 (socket says 172.21.15.33:43840) 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa093fff700 1 -- 172.21.15.33:0/2901024792 learned_addr learned my addr 172.21.15.33:0/2901024792 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0995aa700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa0940b3d20 0x7fa0940b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa098da9700 1 --2- 172.21.15.33:0/2901024792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159570 0x7fa0940b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0937fe700 1 -- 172.21.15.33:0/2901024792 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917848298 0 0) 0x7fa0940b0fc0 con 0x7fa094159940 2024-08-15T17:54:56.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0937fe700 1 -- 172.21.15.33:0/2901024792 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa080003570 con 0x7fa094159940 2024-08-15T17:54:56.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0995aa700 1 -- 172.21.15.33:0/2901024792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159570 msgr2=0x7fa0940b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0995aa700 1 --2- 172.21.15.33:0/2901024792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159570 0x7fa0940b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0995aa700 1 -- 172.21.15.33:0/2901024792 >> v1:172.21.15.33:6789/0 conn(0x7fa094159940 legacy=0x7fa0940b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0995aa700 1 -- 172.21.15.33:0/2901024792 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0940b12a0 con 0x7fa0940b3d20 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0995aa700 1 --2- 172.21.15.33:0/2901024792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0940b3d20 0x7fa0940b41c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0098e0 tx=0x7fa08c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa699e3c6eac88 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0937fe700 1 -- 172.21.15.33:0/2901024792 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011630 con 0x7fa0940b3d20 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0937fe700 1 -- 172.21.15.33:0/2901024792 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c011790 con 0x7fa0940b3d20 2024-08-15T17:54:56.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa0937fe700 1 -- 172.21.15.33:0/2901024792 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011b30 con 0x7fa0940b3d20 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 -- 172.21.15.33:0/2901024792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0940b3d20 msgr2=0x7fa0940b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 --2- 172.21.15.33:0/2901024792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0940b3d20 0x7fa0940b41c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0098e0 tx=0x7fa08c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 -- 172.21.15.33:0/2901024792 shutdown_connections 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 --2- 172.21.15.33:0/2901024792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0940b3d20 0x7fa0940b41c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 --2- 172.21.15.33:0/2901024792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159570 0x7fa0940b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.178+0000 7fa09b00d700 1 -- 172.21.15.33:0/2901024792 >> 172.21.15.33:0/2901024792 conn(0x7fa0940996f0 msgr2=0x7fa094067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:56.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.182+0000 7fa09b00d700 1 -- 172.21.15.33:0/2901024792 shutdown_connections 2024-08-15T17:54:56.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.182+0000 7fa09b00d700 1 -- 172.21.15.33:0/2901024792 wait complete. 2024-08-15T17:54:56.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.182+0000 7fa09b00d700 1 Processor -- start 2024-08-15T17:54:56.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.182+0000 7fa09b00d700 1 -- start start 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0940b3d20 0x7fa0940c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 0x7fa0940c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159940 0x7fa0940ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940c65d0 con 0x7fa094159570 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940c6820 con 0x7fa0940b3d20 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940c6b00 con 0x7fa094159940 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 0x7fa0940c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 0x7fa0940c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60014/0 (socket says 172.21.15.33:60014) 2024-08-15T17:54:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 -- 172.21.15.33:0/737189711 learned_addr learned my addr 172.21.15.33:0/737189711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa098da9700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0940b3d20 0x7fa0940c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa0995aa700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159940 0x7fa0940ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 -- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159940 msgr2=0x7fa0940ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159940 0x7fa0940ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 -- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0940b3d20 msgr2=0x7fa0940c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0940b3d20 0x7fa0940c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 -- 172.21.15.33:0/737189711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c009420 con 0x7fa094159570 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa0995aa700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159940 0x7fa0940ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa093fff700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 0x7fa0940c75e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00cd30 tx=0x7fa07c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00ce90 con 0x7fa094159570 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00ab70 con 0x7fa094159570 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0940c6de0 con 0x7fa094159570 2024-08-15T17:54:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0070f0 con 0x7fa094159570 2024-08-15T17:54:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0940c6160 con 0x7fa094159570 2024-08-15T17:54:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09415a090 con 0x7fa094159570 2024-08-15T17:54:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.186+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa07c007520 con 0x7fa094159570 2024-08-15T17:54:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.190+0000 7fa090ff9700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa074060860 0x7fa074062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.190+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa07c07d380 con 0x7fa094159570 2024-08-15T17:54:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.190+0000 7fa098da9700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa074060860 0x7fa074062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.190+0000 7fa098da9700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa074060860 0x7fa074062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa084009cf0 tx=0x7fa0840091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:56.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.194+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa09415a090 con 0x7fa094159570 2024-08-15T17:54:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.402+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000657299", "format": "json"} v 0) v1 -- 0x7fa09415a090 con 0x7fa094159570 2024-08-15T17:54:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.402+0000 7fa090ff9700 1 -- 172.21.15.33:0/737189711 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000657299", "format": "json"}]=0 v17) v1 ==== 110+0+1847 (secure 0 0 0) 0x7fa09415a090 con 0x7fa094159570 2024-08-15T17:54:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:54:56.406 INFO:teuthology.orchestra.run.smithi033.stdout:{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3} 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.406+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa074060860 msgr2=0x7fa074062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.406+0000 7fa09b00d700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa074060860 0x7fa074062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa084009cf0 tx=0x7fa0840091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.406+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 msgr2=0x7fa0940c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.406+0000 7fa09b00d700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 0x7fa0940c75e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00cd30 tx=0x7fa07c001b10 comp rx=0 tx=0).stop 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 shutdown_connections 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa074060860 0x7fa074062d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa094159940 0x7fa0940ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa094159570 0x7fa0940c75e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 --2- 172.21.15.33:0/737189711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0940b3d20 0x7fa0940c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 >> 172.21.15.33:0/737189711 conn(0x7fa0940996f0 msgr2=0x7fa09409a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 shutdown_connections 2024-08-15T17:54:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.410+0000 7fa09b00d700 1 -- 172.21.15.33:0/737189711 wait complete. 2024-08-15T17:54:56.429 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000657299 --yes-i-really-mean-it 2024-08-15T17:54:56.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.542+0000 7f40abfff700 1 Processor -- start 2024-08-15T17:54:56.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.542+0000 7f40abfff700 1 -- start start 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 0x7f40ac0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f40ac159480 0x7f40ac0cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0ce210 con 0x7f40ac1590b0 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0cba00 con 0x7f40ac159480 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0cdc90 con 0x7f40ac067510 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aaffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f40ac1590b0 0x7f40ac066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43854/0 (socket says 172.21.15.33:43854) 2024-08-15T17:54:56.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aaffd700 1 -- 172.21.15.33:0/3982005591 learned_addr learned my addr 172.21.15.33:0/3982005591 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:54:56.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40ab7fe700 1 --2- 172.21.15.33:0/3982005591 >> v2:172.21.15.105:3300/0 conn(0x7f40ac159480 0x7f40ac0cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 0x7f40ac0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850566995 0 0) 0x7f40ac0ce210 con 0x7f40ac1590b0 2024-08-15T17:54:56.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4094003570 con 0x7f40ac1590b0 2024-08-15T17:54:56.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 132002161 0 0) 0x7f4094003570 con 0x7f40ac1590b0 2024-08-15T17:54:56.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 msgr2=0x7f40ac0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:56.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 0x7f40ac0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 >> v2:172.21.15.105:3300/0 conn(0x7f40ac159480 msgr2=0x7f40ac0cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 --2- 172.21.15.33:0/3982005591 >> v2:172.21.15.105:3300/0 conn(0x7f40ac159480 0x7f40ac0cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0cb440 con 0x7f40ac1590b0 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f409c001470 con 0x7f40ac1590b0 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 >> v1:172.21.15.33:6789/0 conn(0x7f40ac1590b0 legacy=0x7f40ac066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 0x7f4094003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094003fe0 0x7f4094004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4094004d50 0x7f40940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0cdc90 con 0x7f4094003fe0 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409400ba60 con 0x7f4094004d50 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409400bbd0 con 0x7f40ac067510 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094003fe0 0x7f4094004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40ab7fe700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4094004d50 0x7f40940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aaffd700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 0x7f4094003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 -- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 msgr2=0x7f4094003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40ac067510 0x7f4094003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 -- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4094004d50 msgr2=0x7f40940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4094004d50 0x7f40940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 -- 172.21.15.33:0/3982005591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094003570 con 0x7f4094003fe0 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094003fe0 0x7f4094004810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009c00 tx=0x7f40a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5f4ddfae66807b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000e6b0 con 0x7f4094003fe0 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000e810 con 0x7f4094003fe0 2024-08-15T17:54:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40a9ffb700 1 -- 172.21.15.33:0/3982005591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000ebd0 con 0x7f4094003fe0 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 -- 172.21.15.33:0/3982005591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094003fe0 msgr2=0x7f4094004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40abfff700 1 --2- 172.21.15.33:0/3982005591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094003fe0 0x7f4094004810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009c00 tx=0x7f40a00091a0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.546+0000 7f40ab7fe700 1 -- 172.21.15.33:0/3982005591 reap_dead start 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- 172.21.15.33:0/3982005591 shutdown_connections 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- 172.21.15.33:0/3982005591 >> 172.21.15.33:0/3982005591 conn(0x7f40ac0d0b90 msgr2=0x7f40ac0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- 172.21.15.33:0/3982005591 shutdown_connections 2024-08-15T17:54:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- 172.21.15.33:0/3982005591 wait complete. 2024-08-15T17:54:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 Processor -- start 2024-08-15T17:54:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- start start 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4094003fe0 0x7f40ac157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40ac0b4450 0x7f40ac0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40ac15e7b0 0x7f40ac15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac15bd30 con 0x7f40ac0b4450 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0b4e00 con 0x7f40ac15e7b0 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40abfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0c8b00 con 0x7f4094003fe0 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40aa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40ac0b4450 0x7f40ac0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40aaffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4094003fe0 0x7f40ac157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40ab7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40ac15e7b0 0x7f40ac15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40aa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40ac0b4450 0x7f40ac0b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60036/0 (socket says 172.21.15.33:60036) 2024-08-15T17:54:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.550+0000 7f40aa7fc700 1 -- 172.21.15.33:0/554738319 learned_addr learned my addr 172.21.15.33:0/554738319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:54:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40aa7fc700 1 -- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4094003fe0 msgr2=0x7f40ac157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4094003fe0 0x7f40ac157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40aa7fc700 1 -- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40ac15e7b0 msgr2=0x7f40ac15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40ac15e7b0 0x7f40ac15ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40aa7fc700 1 -- 172.21.15.33:0/554738319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac15f490 con 0x7f40ac0b4450 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40aa7fc700 1 --2- 172.21.15.33:0/554738319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40ac0b4450 0x7f40ac0b48c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f40a000e4b0 tx=0x7f40a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f4092ffd700 1 -- 172.21.15.33:0/554738319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0022070 con 0x7f40ac0b4450 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f4092ffd700 1 -- 172.21.15.33:0/554738319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000e980 con 0x7f40ac0b4450 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f4092ffd700 1 -- 172.21.15.33:0/554738319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000e6b0 con 0x7f40ac0b4450 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40abfff700 1 -- 172.21.15.33:0/554738319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac15f770 con 0x7f40ac0b4450 2024-08-15T17:54:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40abfff700 1 -- 172.21.15.33:0/554738319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac15fd30 con 0x7f40ac0b4450 2024-08-15T17:54:56.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f40abfff700 1 -- 172.21.15.33:0/554738319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac0c8d20 con 0x7f40ac0b4450 2024-08-15T17:54:56.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.554+0000 7f4092ffd700 1 -- 172.21.15.33:0/554738319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f40a0027680 con 0x7f40ac0b4450 2024-08-15T17:54:56.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.558+0000 7f4092ffd700 1 --2- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4098060860 0x7f4098062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:54:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.558+0000 7f4092ffd700 1 -- 172.21.15.33:0/554738319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f40a007e6f0 con 0x7f40ac0b4450 2024-08-15T17:54:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.558+0000 7f40aaffd700 1 --2- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4098060860 0x7f4098062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:54:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.558+0000 7f40aaffd700 1 --2- 172.21.15.33:0/554738319 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4098060860 0x7f4098062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f409c000e50 tx=0x7f409c001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:54:56.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.562+0000 7f4092ffd700 1 -- 172.21.15.33:0/554738319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f40ac0c8d20 con 0x7f40ac0b4450 2024-08-15T17:54:56.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:54:56.750+0000 7f40abfff700 1 -- 172.21.15.33:0/554738319 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000657299", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f40ac0c8d20 con 0x7f4098060860 2024-08-15T17:54:59.688 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-08-15T17:54:59.684+0000 7f1ebc38d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-15T17:55:23.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:55:23.204 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:55:53.257 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:55:53.261 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:56:23.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:56:23.343 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:56:53.394 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:56:53.398 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:56:56.450 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-15T17:56:56.452 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-15T17:56:56.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-15T17:56:56.472 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-15T17:56:56.492 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-15T17:56:56.492 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-08-15T17:56:56.492 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-15T17:56:56.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-15T17:56:56.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[33376]: fuse finished with error 0 and tester_r 0 2024-08-15T17:56:56.508 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:56:56.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:56:56.509 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-15T17:56:56.607 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi105.front.sepia.ceph.com... 2024-08-15T17:56:56.607 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-15T17:56:56.607 DEBUG:teuthology.orchestra.run.smithi105:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-15T17:56:56.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[30171]: fuse finished with error 0 and tester_r 0 2024-08-15T17:56:56.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:56:56.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:56:56.625 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-15T17:56:56.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:56:56.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:56:56.768 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-15T17:56:56.775 INFO:teuthology.orchestra.run.smithi033.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-15T17:56:56.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:56:56.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:56:56.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:56:56.776 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-15T17:56:56.783 INFO:teuthology.orchestra.run.smithi105.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-15T17:56:56.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:56:56.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:56:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.932+0000 7f63da2a7700 1 Processor -- start 2024-08-15T17:56:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.932+0000 7f63da2a7700 1 -- start start 2024-08-15T17:56:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63d406e620 0x7f63d40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d4141a00 con 0x7f63d40b0d20 2024-08-15T17:56:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d4140b10 con 0x7f63d406e620 2024-08-15T17:56:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4140df0 con 0x7f63d40b1630 2024-08-15T17:56:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63d406e620 0x7f63d40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:56.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d92a5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f63d40b0d20 0x7f63d406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43140/0 (socket says 172.21.15.33:43140) 2024-08-15T17:56:56.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63d406e620 0x7f63d40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60606/0 (socket says 172.21.15.33:60606) 2024-08-15T17:56:56.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 -- 172.21.15.33:0/2084947438 learned_addr learned my addr 172.21.15.33:0/2084947438 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:56.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d9aa6700 1 --2- 172.21.15.33:0/2084947438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:56.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 -- 172.21.15.33:0/2084947438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 msgr2=0x7f63d4141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:56.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63cbfff700 1 -- 172.21.15.33:0/2084947438 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072093410 0 0) 0x7f63d4141a00 con 0x7f63d40b0d20 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 --2- 172.21.15.33:0/2084947438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d4141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 -- 172.21.15.33:0/2084947438 >> v1:172.21.15.33:6789/0 conn(0x7f63d40b0d20 legacy=0x7f63d406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 -- 172.21.15.33:0/2084947438 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d41410d0 con 0x7f63d406e620 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63d8aa4700 1 --2- 172.21.15.33:0/2084947438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40b10f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f63d00099b0 tx=0x7f63d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3bee4aa04453c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63cbfff700 1 -- 172.21.15.33:0/2084947438 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0009ea0 con 0x7f63d406e620 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63cbfff700 1 -- 172.21.15.33:0/2084947438 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000b860 con 0x7f63d406e620 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63cbfff700 1 -- 172.21.15.33:0/2084947438 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000bc00 con 0x7f63d406e620 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- 172.21.15.33:0/2084947438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 msgr2=0x7f63d40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 --2- 172.21.15.33:0/2084947438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40b10f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f63d00099b0 tx=0x7f63d0009250 comp rx=0 tx=0).stop 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- 172.21.15.33:0/2084947438 shutdown_connections 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 --2- 172.21.15.33:0/2084947438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d4141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 --2- 172.21.15.33:0/2084947438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40b10f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- 172.21.15.33:0/2084947438 >> 172.21.15.33:0/2084947438 conn(0x7f63d40678d0 msgr2=0x7f63d4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- 172.21.15.33:0/2084947438 shutdown_connections 2024-08-15T17:56:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.936+0000 7f63da2a7700 1 -- 172.21.15.33:0/2084947438 wait complete. 2024-08-15T17:56:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.940+0000 7f63da2a7700 1 Processor -- start 2024-08-15T17:56:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.940+0000 7f63da2a7700 1 -- start start 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63d40b0d20 0x7f63d40a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d40a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40a5640 con 0x7f63d406e620 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40a61c0 con 0x7f63d40b0d20 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40a5890 con 0x7f63d40b1630 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60622/0 (socket says 172.21.15.33:60622) 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 -- 172.21.15.33:0/725936493 learned_addr learned my addr 172.21.15.33:0/725936493 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d8aa4700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63d40b0d20 0x7f63d40a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d9aa6700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d40a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 -- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 msgr2=0x7f63d40a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d40a8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 -- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63d40b0d20 msgr2=0x7f63d40a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63d40b0d20 0x7f63d40a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 -- 172.21.15.33:0/725936493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00094f0 con 0x7f63d406e620 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d9aa6700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d40a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63d92a5700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40ad810 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c7e0 tx=0x7f63c4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005a70 con 0x7f63d406e620 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4005bd0 con 0x7f63d406e620 2024-08-15T17:56:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40a5b70 con 0x7f63d406e620 2024-08-15T17:56:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c40070d0 con 0x7f63d406e620 2024-08-15T17:56:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40add50 con 0x7f63d406e620 2024-08-15T17:56:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.944+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d40643a0 con 0x7f63d406e620 2024-08-15T17:56:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.948+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f63c40074c0 con 0x7f63d406e620 2024-08-15T17:56:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.948+0000 7f63c97fa700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f63b8060860 0x7f63b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.948+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f63c407c3f0 con 0x7f63d406e620 2024-08-15T17:56:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.948+0000 7f63d8aa4700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f63b8060860 0x7f63b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.948+0000 7f63d8aa4700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f63b8060860 0x7f63b8062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63d00099b0 tx=0x7f63d0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:56.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:56.956+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f63c404c500 con 0x7f63d406e620 2024-08-15T17:56:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.156+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63d406f5f0 con 0x7f63d406e620 2024-08-15T17:56:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.156+0000 7f63c97fa700 1 -- 172.21.15.33:0/725936493 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f63c404fb20 con 0x7f63d406e620 2024-08-15T17:56:57.157 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:56:57.157 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:39.333104+0000","modified":"2024-08-15T17:54:42.968502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5002":{"gid":5002,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2964556950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2964556950},{"type":"v1","addr":"172.21.15.105:6837","nonce":2964556950}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f63b8060860 msgr2=0x7f63b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f63b8060860 0x7f63b8062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63d00099b0 tx=0x7f63d0017000 comp rx=0 tx=0).stop 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 msgr2=0x7f63d40ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40ad810 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c7e0 tx=0x7f63c4007e10 comp rx=0 tx=0).stop 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 shutdown_connections 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f63b8060860 0x7f63b8062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63d40b0d20 0x7f63d40a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63d40b1630 0x7f63d40a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 --2- 172.21.15.33:0/725936493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63d406e620 0x7f63d40ad810 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 >> 172.21.15.33:0/725936493 conn(0x7f63d40678d0 msgr2=0x7f63d415e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 shutdown_connections 2024-08-15T17:56:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.160+0000 7f63da2a7700 1 -- 172.21.15.33:0/725936493 wait complete. 2024-08-15T17:56:57.163 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-08-15T17:56:57.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:56:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9cc9e700 1 Processor -- start 2024-08-15T17:56:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9cc9e700 1 -- start start 2024-08-15T17:56:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9cc9e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d980af030 0x7f2d980a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9cc9e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980b00d0 con 0x7f2d980a8f50 2024-08-15T17:56:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9cc9e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d98159d40 con 0x7f2d981598a0 2024-08-15T17:56:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9cc9e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980af4c0 con 0x7f2d980af030 2024-08-15T17:56:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2d980a8f50 0x7f2d980b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43156/0 (socket says 172.21.15.33:43156) 2024-08-15T17:56:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9659c700 1 -- 172.21.15.33:0/1140776914 learned_addr learned my addr 172.21.15.33:0/1140776914 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:57.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d95d9b700 1 --2- 172.21.15.33:0/1140776914 >> v2:172.21.15.105:3300/0 conn(0x7f2d980af030 0x7f2d980a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116092444 0 0) 0x7f2d980b00d0 con 0x7f2d980a8f50 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d80003570 con 0x7f2d980a8f50 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656754862 0 0) 0x7f2d98159d40 con 0x7f2d981598a0 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d980b00d0 con 0x7f2d981598a0 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 83533524 0 0) 0x7f2d80003570 con 0x7f2d980a8f50 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d95d9b700 1 -- 172.21.15.33:0/1140776914 >> v1:172.21.15.105:6789/0 conn(0x7f2d981598a0 legacy=0x7f2d980b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d95d9b700 1 -- 172.21.15.33:0/1140776914 >> v1:172.21.15.33:6789/0 conn(0x7f2d980a8f50 legacy=0x7f2d980b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d95d9b700 1 -- 172.21.15.33:0/1140776914 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980af7a0 con 0x7f2d980af030 2024-08-15T17:56:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.284+0000 7f2d95d9b700 1 --2- 172.21.15.33:0/1140776914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d980af030 0x7f2d980a9320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0098e0 tx=0x7f2d8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05dbe1bd364beba server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900017f0 con 0x7f2d980af030 2024-08-15T17:56:57.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c011420 con 0x7f2d980af030 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9559a700 1 -- 172.21.15.33:0/1140776914 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0117c0 con 0x7f2d980af030 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/1140776914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d980af030 msgr2=0x7f2d980a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/1140776914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d980af030 0x7f2d980a9320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0098e0 tx=0x7f2d8c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/1140776914 shutdown_connections 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/1140776914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d980af030 0x7f2d980a9320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/1140776914 >> 172.21.15.33:0/1140776914 conn(0x7f2d98066e00 msgr2=0x7f2d98067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/1140776914 shutdown_connections 2024-08-15T17:56:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/1140776914 wait complete. 2024-08-15T17:56:57.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 Processor -- start 2024-08-15T17:56:57.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.288+0000 7f2d9cc9e700 1 -- start start 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 0x7f2d98098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d980af030 0x7f2d980991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d981598a0 0x7f2d980acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98169870 con 0x7f2d980a8f50 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c5fb0 con 0x7f2d981598a0 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98099df0 con 0x7f2d980af030 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 0x7f2d98098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 0x7f2d98098c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60634/0 (socket says 172.21.15.33:60634) 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 -- 172.21.15.33:0/834962569 learned_addr learned my addr 172.21.15.33:0/834962569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:57.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d95d9b700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d980af030 0x7f2d980991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d96d9d700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d981598a0 0x7f2d980acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 -- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d980af030 msgr2=0x7f2d980991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d980af030 0x7f2d980991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 -- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d981598a0 msgr2=0x7f2d980acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d981598a0 0x7f2d980acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 -- 172.21.15.33:0/834962569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009420 con 0x7f2d980a8f50 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d96d9d700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d981598a0 0x7f2d980acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9659c700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 0x7f2d98098c70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000cc10 tx=0x7f2d90007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90004dc0 con 0x7f2d980a8f50 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000a690 con 0x7f2d980a8f50 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d98169540 con 0x7f2d980a8f50 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000aa50 con 0x7f2d980a8f50 2024-08-15T17:56:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.292+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d98099b10 con 0x7f2d980a8f50 2024-08-15T17:56:57.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.296+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d980645c0 con 0x7f2d980a8f50 2024-08-15T17:56:57.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.296+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2d90007150 con 0x7f2d980a8f50 2024-08-15T17:56:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.296+0000 7f2d867fc700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d78060860 0x7f2d78062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.296+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2d9007cb60 con 0x7f2d980a8f50 2024-08-15T17:56:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.296+0000 7f2d95d9b700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d78060860 0x7f2d78062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.296+0000 7f2d95d9b700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d78060860 0x7f2d78062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0093f0 tx=0x7f2d8c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.304+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2d9004cbc0 con 0x7f2d980a8f50 2024-08-15T17:56:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.472+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d980c5ad0 con 0x7f2d980a8f50 2024-08-15T17:56:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d867fc700 1 -- 172.21.15.33:0/834962569 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18789 (secure 0 0 0) 0x7f2d9006ae60 con 0x7f2d980a8f50 2024-08-15T17:56:57.476 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:56:57.476 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:55:32.481799+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.1a","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:56:57.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d78060860 msgr2=0x7f2d78062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d78060860 0x7f2d78062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0093f0 tx=0x7f2d8c016000 comp rx=0 tx=0).stop 2024-08-15T17:56:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 msgr2=0x7f2d98098c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 0x7f2d98098c70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000cc10 tx=0x7f2d90007d50 comp rx=0 tx=0).stop 2024-08-15T17:56:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 shutdown_connections 2024-08-15T17:56:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2d78060860 0x7f2d78062d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d981598a0 0x7f2d980acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d980af030 0x7f2d980991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 --2- 172.21.15.33:0/834962569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d980a8f50 0x7f2d98098c70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 >> 172.21.15.33:0/834962569 conn(0x7f2d98066e00 msgr2=0x7f2d9815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 shutdown_connections 2024-08-15T17:56:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.476+0000 7f2d9cc9e700 1 -- 172.21.15.33:0/834962569 wait complete. 2024-08-15T17:56:57.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-15T17:54:37.596331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-15T17:54:38.323771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000657299.meta', 'create_time': '2024-08-15T17:54:52.374842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000657299'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000657299.data', 'create_time': '2024-08-15T17:54:53.390917+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000657299'}}}] 2024-08-15T17:56:57.491 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:56:57.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.604+0000 7f1f992fa700 1 Processor -- start 2024-08-15T17:56:57.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.604+0000 7f1f992fa700 1 -- start start 2024-08-15T17:56:57.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.604+0000 7f1f992fa700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f940688d0 0x7f1f940aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f940ab0f0 con 0x7f1f94068ca0 2024-08-15T17:56:57.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f940ab3d0 con 0x7f1f94158b70 2024-08-15T17:56:57.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f940ab6b0 con 0x7f1f940688d0 2024-08-15T17:56:57.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f8b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1f94068ca0 0x7f1f94066ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43166/0 (socket says 172.21.15.33:43166) 2024-08-15T17:56:57.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f8b7fe700 1 -- 172.21.15.33:0/3883432809 learned_addr learned my addr 172.21.15.33:0/3883432809 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:57.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f93fff700 1 --2- 172.21.15.33:0/3883432809 >> v2:172.21.15.105:3300/0 conn(0x7f1f940688d0 0x7f1f940aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071948463 0 0) 0x7f1f940ab0f0 con 0x7f1f94068ca0 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f80003570 con 0x7f1f94068ca0 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758219415 0 0) 0x7f1f940ab3d0 con 0x7f1f94158b70 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f940ab0f0 con 0x7f1f94158b70 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f93fff700 1 -- 172.21.15.33:0/3883432809 >> v1:172.21.15.105:6789/0 conn(0x7f1f94158b70 legacy=0x7f1f94158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f93fff700 1 -- 172.21.15.33:0/3883432809 >> v1:172.21.15.33:6789/0 conn(0x7f1f94068ca0 legacy=0x7f1f94066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f93fff700 1 -- 172.21.15.33:0/3883432809 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940ab990 con 0x7f1f940688d0 2024-08-15T17:56:57.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f93fff700 1 --2- 172.21.15.33:0/3883432809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f940aab10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f840098e0 tx=0x7f1f840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f319b3086d6687 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84011630 con 0x7f1f940688d0 2024-08-15T17:56:57.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84011790 con 0x7f1f940688d0 2024-08-15T17:56:57.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f937fe700 1 -- 172.21.15.33:0/3883432809 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84011b30 con 0x7f1f940688d0 2024-08-15T17:56:57.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- 172.21.15.33:0/3883432809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 msgr2=0x7f1f940aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3883432809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f940aab10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f840098e0 tx=0x7f1f840091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- 172.21.15.33:0/3883432809 shutdown_connections 2024-08-15T17:56:57.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3883432809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f940aab10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- 172.21.15.33:0/3883432809 >> 172.21.15.33:0/3883432809 conn(0x7f1f9406e310 msgr2=0x7f1f9406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:57.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- 172.21.15.33:0/3883432809 shutdown_connections 2024-08-15T17:56:57.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.608+0000 7f1f992fa700 1 -- 172.21.15.33:0/3883432809 wait complete. 2024-08-15T17:56:57.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.612+0000 7f1f992fa700 1 Processor -- start 2024-08-15T17:56:57.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.612+0000 7f1f992fa700 1 -- start start 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f9414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f94068ca0 0x7f1f9415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f94158b70 0x7f1f94159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9415e6b0 con 0x7f1f94158b70 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9415daa0 con 0x7f1f940688d0 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9415dd80 con 0x7f1f94068ca0 2024-08-15T17:56:57.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f98af9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f94158b70 0x7f1f94159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f9414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f9414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:40286/0 (socket says 172.21.15.33:40286) 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f8b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f94068ca0 0x7f1f9415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 -- 172.21.15.33:0/3340516885 learned_addr learned my addr 172.21.15.33:0/3340516885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 -- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f94068ca0 msgr2=0x7f1f9415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f94068ca0 0x7f1f9415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 -- 172.21.15.33:0/3340516885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f94158b70 msgr2=0x7f1f94159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f94158b70 0x7f1f94159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 -- 172.21.15.33:0/3340516885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84009420 con 0x7f1f940688d0 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f98af9700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f94158b70 0x7f1f94159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f93fff700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f9414dc50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f94064ce0 tx=0x7f1f84017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8401f070 con 0x7f1f940688d0 2024-08-15T17:56:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84002f70 con 0x7f1f940688d0 2024-08-15T17:56:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9415e060 con 0x7f1f940688d0 2024-08-15T17:56:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84011900 con 0x7f1f940688d0 2024-08-15T17:56:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9414e190 con 0x7f1f940688d0 2024-08-15T17:56:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.616+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9415e4e0 con 0x7f1f940688d0 2024-08-15T17:56:57.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.620+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1f84023070 con 0x7f1f940688d0 2024-08-15T17:56:57.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.620+0000 7f1f90ff9700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f74060860 0x7f1f74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.620+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1f8407ea40 con 0x7f1f940688d0 2024-08-15T17:56:57.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.620+0000 7f1f8b7fe700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f74060860 0x7f1f74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.620+0000 7f1f8b7fe700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f74060860 0x7f1f74062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f9415ed20 tx=0x7f1f7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.632+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1f84052490 con 0x7f1f940688d0 2024-08-15T17:56:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.796+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f940638f0 con 0x7f1f940688d0 2024-08-15T17:56:57.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.796+0000 7f1f90ff9700 1 -- 172.21.15.33:0/3340516885 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f84033020 con 0x7f1f940688d0 2024-08-15T17:56:57.798 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:56:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f74060860 msgr2=0x7f1f74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f74060860 0x7f1f74062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f9415ed20 tx=0x7f1f7c009040 comp rx=0 tx=0).stop 2024-08-15T17:56:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 msgr2=0x7f1f9414dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f9414dc50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f94064ce0 tx=0x7f1f84017000 comp rx=0 tx=0).stop 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 shutdown_connections 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1f74060860 0x7f1f74062d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f94158b70 0x7f1f94159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f94068ca0 0x7f1f9415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 --2- 172.21.15.33:0/3340516885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f940688d0 0x7f1f9414dc50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 >> 172.21.15.33:0/3340516885 conn(0x7f1f9406e310 msgr2=0x7f1f940af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 shutdown_connections 2024-08-15T17:56:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.800+0000 7f1f992fa700 1 -- 172.21.15.33:0/3340516885 wait complete. 2024-08-15T17:56:57.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-15T17:56:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fcc77e700 1 Processor -- start 2024-08-15T17:56:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fcc77e700 1 -- start start 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fcc77e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4fc41596d0 0x7f4fc4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fcc77e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cba90 con 0x7f4fc4159300 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fcc77e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cb160 con 0x7f4fc415dbc0 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fcc77e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40b2b60 con 0x7f4fc41596d0 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fc9d19700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4fc41596d0 0x7f4fc4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.924+0000 7f4fca51a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4fc4159300 0x7f4fc40b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52616/0 (socket says 172.21.15.33:52616) 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9d19700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4fc41596d0 0x7f4fc4066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52496/0 (socket says 172.21.15.33:52496) 2024-08-15T17:56:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fca51a700 1 -- 172.21.15.33:0/1667756206 learned_addr learned my addr 172.21.15.33:0/1667756206 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9d19700 1 -- 172.21.15.33:0/1667756206 >> v1:172.21.15.105:6789/0 conn(0x7f4fc415dbc0 legacy=0x7f4fc40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9d19700 1 -- 172.21.15.33:0/1667756206 >> v1:172.21.15.33:6789/0 conn(0x7f4fc4159300 legacy=0x7f4fc40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9518700 1 -- 172.21.15.33:0/1667756206 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72984827 0 0) 0x7f4fc40cba90 con 0x7f4fc4159300 2024-08-15T17:56:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9d19700 1 -- 172.21.15.33:0/1667756206 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40cb440 con 0x7f4fc41596d0 2024-08-15T17:56:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9d19700 1 --2- 172.21.15.33:0/1667756206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc41596d0 0x7f4fc4066e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00098e0 tx=0x7f4fc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3333ff006885af77 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9518700 1 -- 172.21.15.33:0/1667756206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0009e80 con 0x7f4fc41596d0 2024-08-15T17:56:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9518700 1 -- 172.21.15.33:0/1667756206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000b860 con 0x7f4fc41596d0 2024-08-15T17:56:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fc9518700 1 -- 172.21.15.33:0/1667756206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000bbe0 con 0x7f4fc41596d0 2024-08-15T17:56:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1667756206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc41596d0 msgr2=0x7f4fc4066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1667756206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc41596d0 0x7f4fc4066e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00098e0 tx=0x7f4fc00091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1667756206 shutdown_connections 2024-08-15T17:56:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1667756206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc41596d0 0x7f4fc4066e00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1667756206 >> 172.21.15.33:0/1667756206 conn(0x7f4fc40682c0 msgr2=0x7f4fc40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1667756206 shutdown_connections 2024-08-15T17:56:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.928+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1667756206 wait complete. 2024-08-15T17:56:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 Processor -- start 2024-08-15T17:56:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 -- start start 2024-08-15T17:56:57.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 0x7f4fc415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc41596d0 0x7f4fc4158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fc415dbc0 0x7f4fc41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc415b9f0 con 0x7f4fc4159300 2024-08-15T17:56:57.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc415d6b0 con 0x7f4fc41596d0 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fca51a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 0x7f4fc415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcc77e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc415caa0 con 0x7f4fc415dbc0 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fca51a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 0x7f4fc415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52506/0 (socket says 172.21.15.33:52506) 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fca51a700 1 -- 172.21.15.33:0/1190837710 learned_addr learned my addr 172.21.15.33:0/1190837710 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fc9d19700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc41596d0 0x7f4fc4158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.932+0000 7f4fcad1b700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fc415dbc0 0x7f4fc41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fca51a700 1 -- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fc415dbc0 msgr2=0x7f4fc41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fca51a700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fc415dbc0 0x7f4fc41549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fca51a700 1 -- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc41596d0 msgr2=0x7f4fc4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fca51a700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc41596d0 0x7f4fc4158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fca51a700 1 -- 172.21.15.33:0/1190837710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009420 con 0x7f4fc4159300 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fcad1b700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fc415dbc0 0x7f4fc41549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:56:57.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fca51a700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 0x7f4fc415a440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c810 tx=0x7f4fb4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4005c00 con 0x7f4fc4159300 2024-08-15T17:56:57.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4005d60 con 0x7f4fc4159300 2024-08-15T17:56:57.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc415cd80 con 0x7f4fc4159300 2024-08-15T17:56:57.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4007320 con 0x7f4fc4159300 2024-08-15T17:56:57.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc415d110 con 0x7f4fc4159300 2024-08-15T17:56:57.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc4156af0 con 0x7f4fc4159300 2024-08-15T17:56:57.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.936+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4fb401b3b0 con 0x7f4fc4159300 2024-08-15T17:56:57.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.940+0000 7f4fba7fc700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4fa8060860 0x7f4fa8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:57.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.940+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4fb407c530 con 0x7f4fc4159300 2024-08-15T17:56:57.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.940+0000 7f4fc9d19700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4fa8060860 0x7f4fa8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:57.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.940+0000 7f4fc9d19700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4fa8060860 0x7f4fa8062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00093f0 tx=0x7f4fc0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:57.944+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4fc4156af0 con 0x7f4fc4159300 2024-08-15T17:56:58.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.108+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fc4156af0 con 0x7f4fc4159300 2024-08-15T17:56:58.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.108+0000 7f4fba7fc700 1 -- 172.21.15.33:0/1190837710 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fc4156af0 con 0x7f4fc4159300 2024-08-15T17:56:58.110 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:56:58.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4fa8060860 msgr2=0x7f4fa8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4fa8060860 0x7f4fa8062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00093f0 tx=0x7f4fc0017000 comp rx=0 tx=0).stop 2024-08-15T17:56:58.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 msgr2=0x7f4fc415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 0x7f4fc415a440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c810 tx=0x7f4fb4007d90 comp rx=0 tx=0).stop 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 shutdown_connections 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f4fa8060860 0x7f4fa8062d10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc41596d0 0x7f4fc4158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fc415dbc0 0x7f4fc41549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 --2- 172.21.15.33:0/1190837710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fc4159300 0x7f4fc415a440 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 >> 172.21.15.33:0/1190837710 conn(0x7f4fc40682c0 msgr2=0x7f4fc41563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 shutdown_connections 2024-08-15T17:56:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.112+0000 7f4fcc77e700 1 -- 172.21.15.33:0/1190837710 wait complete. 2024-08-15T17:56:58.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-15T17:56:58.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 Processor -- start 2024-08-15T17:56:58.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 -- start start 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f780c06eea0 0x7f780c0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f780c152bd0 0x7f780c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0ace30 con 0x7f780c06ead0 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c156dd0 con 0x7f780c06eea0 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7812175700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c156450 con 0x7f780c152bd0 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f780c06eea0 0x7f780c0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f780c06eea0 0x7f780c0b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52514/0 (socket says 172.21.15.33:52514) 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 -- 172.21.15.33:0/257751282 learned_addr learned my addr 172.21.15.33:0/257751282 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7811974700 1 --2- 172.21.15.33:0/257751282 >> v2:172.21.15.105:3300/0 conn(0x7f780c152bd0 0x7f780c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 -- 172.21.15.33:0/257751282 >> v2:172.21.15.105:3300/0 conn(0x7f780c152bd0 msgr2=0x7f780c152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 --2- 172.21.15.33:0/257751282 >> v2:172.21.15.105:3300/0 conn(0x7f780c152bd0 0x7f780c152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 -- 172.21.15.33:0/257751282 >> v1:172.21.15.105:6789/0 conn(0x7f780c06ead0 legacy=0x7f780c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 -- 172.21.15.33:0/257751282 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c156730 con 0x7f780c06eea0 2024-08-15T17:56:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7811974700 1 --2- 172.21.15.33:0/257751282 >> v2:172.21.15.105:3300/0 conn(0x7f780c152bd0 0x7f780c152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:56:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f7810972700 1 --2- 172.21.15.33:0/257751282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c06eea0 0x7f780c0b1830 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f780c05f0e0 tx=0x7f780000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51d98ab3fb14f2b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f77fffff700 1 -- 172.21.15.33:0/257751282 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000dc50 con 0x7f780c06eea0 2024-08-15T17:56:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f77fffff700 1 -- 172.21.15.33:0/257751282 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000ddb0 con 0x7f780c06eea0 2024-08-15T17:56:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.244+0000 7f77fffff700 1 -- 172.21.15.33:0/257751282 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000196d0 con 0x7f780c06eea0 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- 172.21.15.33:0/257751282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c06eea0 msgr2=0x7f780c0b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 --2- 172.21.15.33:0/257751282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c06eea0 0x7f780c0b1830 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f780c05f0e0 tx=0x7f780000b4f0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- 172.21.15.33:0/257751282 shutdown_connections 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 --2- 172.21.15.33:0/257751282 >> v2:172.21.15.105:3300/0 conn(0x7f780c152bd0 0x7f780c152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 --2- 172.21.15.33:0/257751282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c06eea0 0x7f780c0b1830 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- 172.21.15.33:0/257751282 >> 172.21.15.33:0/257751282 conn(0x7f780c0678a0 msgr2=0x7f780c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- 172.21.15.33:0/257751282 shutdown_connections 2024-08-15T17:56:58.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- 172.21.15.33:0/257751282 wait complete. 2024-08-15T17:56:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 Processor -- start 2024-08-15T17:56:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- start start 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780c06ead0 0x7f780c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780c06eea0 0x7f780c168a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 0x7f780c165510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c169a30 con 0x7f780c152bd0 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c169470 con 0x7f780c06ead0 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7812175700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c169750 con 0x7f780c06eea0 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.248+0000 7f7811974700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 0x7f780c165510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 0x7f780c165510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52530/0 (socket says 172.21.15.33:52530) 2024-08-15T17:56:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 -- 172.21.15.33:0/1559475895 learned_addr learned my addr 172.21.15.33:0/1559475895 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7810972700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780c06eea0 0x7f780c168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811173700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780c06ead0 0x7f780c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 -- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780c06eea0 msgr2=0x7f780c168a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780c06eea0 0x7f780c168a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 -- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780c06ead0 msgr2=0x7f780c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780c06ead0 0x7f780c154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 -- 172.21.15.33:0/1559475895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780000b790 con 0x7f780c152bd0 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7811974700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 0x7f780c165510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7804009fc0 tx=0x7f78040099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400dbe0 con 0x7f780c152bd0 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400f040 con 0x7f780c152bd0 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c14f0f0 con 0x7f780c152bd0 2024-08-15T17:56:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804015440 con 0x7f780c152bd0 2024-08-15T17:56:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c14e740 con 0x7f780c152bd0 2024-08-15T17:56:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.252+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c14ef50 con 0x7f780c152bd0 2024-08-15T17:56:58.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.256+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f780401e3b0 con 0x7f780c152bd0 2024-08-15T17:56:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.256+0000 7f77fd7fa700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f77f0060860 0x7f77f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.256+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f780407d490 con 0x7f780c152bd0 2024-08-15T17:56:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.256+0000 7f7811173700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f77f0060860 0x7f77f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.256+0000 7f7811173700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f77f0060860 0x7f77f0062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7808003950 tx=0x7f7808007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.264+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f780c14ef50 con 0x7f780c152bd0 2024-08-15T17:56:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f780c14ef50 con 0x7f780c152bd0 2024-08-15T17:56:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f77fd7fa700 1 -- 172.21.15.33:0/1559475895 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f780c14ef50 con 0x7f780c152bd0 2024-08-15T17:56:58.428 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f77f0060860 msgr2=0x7f77f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f77f0060860 0x7f77f0062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7808003950 tx=0x7f7808007ec0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 msgr2=0x7f780c165510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 0x7f780c165510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7804009fc0 tx=0x7f78040099b0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 shutdown_connections 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f77f0060860 0x7f77f0062d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f780c152bd0 0x7f780c165510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780c06eea0 0x7f780c168a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 --2- 172.21.15.33:0/1559475895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780c06ead0 0x7f780c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 >> 172.21.15.33:0/1559475895 conn(0x7f780c0678a0 msgr2=0x7f780c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 shutdown_connections 2024-08-15T17:56:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.428+0000 7f7812175700 1 -- 172.21.15.33:0/1559475895 wait complete. 2024-08-15T17:56:58.448 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000657299.meta pg_num 2024-08-15T17:56:58.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.560+0000 7fda3a491700 1 Processor -- start 2024-08-15T17:56:58.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.560+0000 7fda3a491700 1 -- start start 2024-08-15T17:56:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3a491700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fda341590b0 0x7fda34066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3a491700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 0x7fda34067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3a491700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340ce210 con 0x7fda34159480 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3a491700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340cba00 con 0x7fda341590b0 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3a491700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cdc90 con 0x7fda340cd2b0 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda38c8e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fda34159480 0x7fda3415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52622/0 (socket says 172.21.15.33:52622) 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda38c8e700 1 -- 172.21.15.33:0/49707981 learned_addr learned my addr 172.21.15.33:0/49707981 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 --2- 172.21.15.33:0/49707981 >> v2:172.21.15.105:3300/0 conn(0x7fda341590b0 0x7fda34066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda39c90700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 0x7fda34067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891659718 0 0) 0x7fda340ce210 con 0x7fda34159480 2024-08-15T17:56:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda20003570 con 0x7fda34159480 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175273041 0 0) 0x7fda20003570 con 0x7fda34159480 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 msgr2=0x7fda34067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 0x7fda34067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 >> v2:172.21.15.105:3300/0 conn(0x7fda341590b0 msgr2=0x7fda34066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 --2- 172.21.15.33:0/49707981 >> v2:172.21.15.105:3300/0 conn(0x7fda341590b0 0x7fda34066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340cb440 con 0x7fda34159480 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fda24001470 con 0x7fda34159480 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 >> v1:172.21.15.33:6789/0 conn(0x7fda34159480 legacy=0x7fda3415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda20003a60 0x7fda20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda20004810 0x7fda20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 0x7fda200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cdc90 con 0x7fda20003a60 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2000ba60 con 0x7fda20004810 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2000bba0 con 0x7fda340cd2b0 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda20003a60 0x7fda20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda38c8e700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda20004810 0x7fda20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda39c90700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 0x7fda200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 -- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 msgr2=0x7fda200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda340cd2b0 0x7fda200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 -- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda20004810 msgr2=0x7fda20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda20004810 0x7fda20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 -- 172.21.15.33:0/49707981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20003570 con 0x7fda20003a60 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda38c8e700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda20004810 0x7fda20004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda3948f700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda20003a60 0x7fda20003e70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fda30009c30 tx=0x7fda300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9539b131a85bf16b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.564+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000e710 con 0x7fda20003a60 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000e870 con 0x7fda20003a60 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda2bfff700 1 -- 172.21.15.33:0/49707981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000ec30 con 0x7fda20003a60 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 -- 172.21.15.33:0/49707981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda20003a60 msgr2=0x7fda20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 --2- 172.21.15.33:0/49707981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda20003a60 0x7fda20003e70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fda30009c30 tx=0x7fda300091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda39c90700 1 -- 172.21.15.33:0/49707981 reap_dead start 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 -- 172.21.15.33:0/49707981 shutdown_connections 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 -- 172.21.15.33:0/49707981 >> 172.21.15.33:0/49707981 conn(0x7fda340d0b90 msgr2=0x7fda340ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 -- 172.21.15.33:0/49707981 shutdown_connections 2024-08-15T17:56:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 -- 172.21.15.33:0/49707981 wait complete. 2024-08-15T17:56:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 Processor -- start 2024-08-15T17:56:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.568+0000 7fda3a491700 1 -- start start 2024-08-15T17:56:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda20003a60 0x7fda34151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3415c080 0x7fda340c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 0x7fda340c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c8060 con 0x7fda3415c4f0 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c7170 con 0x7fda3415c080 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c7450 con 0x7fda20003a60 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda39c90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 0x7fda340c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda39c90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 0x7fda340c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52556/0 (socket says 172.21.15.33:52556) 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3415c080 0x7fda340c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda39c90700 1 -- 172.21.15.33:0/2670533932 learned_addr learned my addr 172.21.15.33:0/2670533932 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:58.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3948f700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda20003a60 0x7fda34151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 -- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda20003a60 msgr2=0x7fda34151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda20003a60 0x7fda34151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 -- 172.21.15.33:0/2670533932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 msgr2=0x7fda340c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 0x7fda340c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 -- 172.21.15.33:0/2670533932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340c7730 con 0x7fda3415c080 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda39c90700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 0x7fda340c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda38c8e700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3415c080 0x7fda340c4e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda24007740 tx=0x7fda24001e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24018030 con 0x7fda3415c080 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24007770 con 0x7fda3415c080 2024-08-15T17:56:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340c7a10 con 0x7fda3415c080 2024-08-15T17:56:58.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400fe00 con 0x7fda3415c080 2024-08-15T17:56:58.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.572+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34151790 con 0x7fda3415c080 2024-08-15T17:56:58.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.576+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34151920 con 0x7fda3415c080 2024-08-15T17:56:58.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.576+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fda2401b070 con 0x7fda3415c080 2024-08-15T17:56:58.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.576+0000 7fda297fa700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fda18060860 0x7fda18062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.576+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fda24019070 con 0x7fda3415c080 2024-08-15T17:56:58.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.576+0000 7fda3948f700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fda18060860 0x7fda18062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.580+0000 7fda3948f700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fda18060860 0x7fda18062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda300091e0 tx=0x7fda3001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.588+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fda2404ce60 con 0x7fda3415c080 2024-08-15T17:56:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.752+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.meta", "var": "pg_num"} v 0) v1 -- 0x7fda34064330 con 0x7fda3415c080 2024-08-15T17:56:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.752+0000 7fda297fa700 1 -- 172.21.15.33:0/2670533932 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.meta", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7fda24050480 con 0x7fda3415c080 2024-08-15T17:56:58.755 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:56:58.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fda18060860 msgr2=0x7fda18062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fda18060860 0x7fda18062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda300091e0 tx=0x7fda3001a000 comp rx=0 tx=0).stop 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3415c080 msgr2=0x7fda340c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3415c080 0x7fda340c4e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda24007740 tx=0x7fda24001e90 comp rx=0 tx=0).stop 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 shutdown_connections 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fda18060860 0x7fda18062d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3415c080 0x7fda340c4e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda3415c4f0 0x7fda340c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 --2- 172.21.15.33:0/2670533932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda20003a60 0x7fda34151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 >> 172.21.15.33:0/2670533932 conn(0x7fda340d0b90 msgr2=0x7fda34066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 shutdown_connections 2024-08-15T17:56:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.756+0000 7fda3a491700 1 -- 172.21.15.33:0/2670533932 wait complete. 2024-08-15T17:56:58.774 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000657299.data pg_num 2024-08-15T17:56:58.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fb55a6700 1 Processor -- start 2024-08-15T17:56:58.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fb55a6700 1 -- start start 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fb55a6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9fb0159400 0x7f9fb00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fb55a6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb00adb00 con 0x7f9fb01597d0 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fb55a6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb006bf60 con 0x7f9fb006bac0 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fb55a6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb00ac630 con 0x7f9fb0159400 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fa67fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9fb01597d0 0x7f9fb00ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52624/0 (socket says 172.21.15.33:52624) 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.888+0000 7f9fa67fc700 1 -- 172.21.15.33:0/1167520499 learned_addr learned my addr 172.21.15.33:0/1167520499 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 --2- 172.21.15.33:0/1167520499 >> v2:172.21.15.105:3300/0 conn(0x7f9fb0159400 0x7f9fb00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618590322 0 0) 0x7f9fb00adb00 con 0x7f9fb01597d0 2024-08-15T17:56:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f9c003570 con 0x7f9fb01597d0 2024-08-15T17:56:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206641762 0 0) 0x7f9f9c003570 con 0x7f9fb01597d0 2024-08-15T17:56:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 >> v2:172.21.15.105:3300/0 conn(0x7f9fb0159400 msgr2=0x7f9fb00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 --2- 172.21.15.33:0/1167520499 >> v2:172.21.15.105:3300/0 conn(0x7f9fb0159400 0x7f9fb00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 >> v1:172.21.15.105:6789/0 conn(0x7f9fb006bac0 legacy=0x7f9fb00686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00ac910 con 0x7f9fb01597d0 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f9f98001470 con 0x7f9fb01597d0 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 >> v1:172.21.15.33:6789/0 conn(0x7f9fb01597d0 legacy=0x7f9fb00ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f9c003a60 0x7f9f9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f9c004810 0x7f9f9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c0051c0 0x7f9f9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00ac630 con 0x7f9f9c003a60 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c00c050 con 0x7f9f9c004810 2024-08-15T17:56:58.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c00c210 con 0x7f9f9c0051c0 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f9c003a60 0x7f9f9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fa67fc700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f9c004810 0x7f9f9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faf7fe700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c0051c0 0x7f9f9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 -- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c0051c0 msgr2=0x7f9f9c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c0051c0 0x7f9f9c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 -- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f9c004810 msgr2=0x7f9f9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f9c004810 0x7f9f9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 -- 172.21.15.33:0/1167520499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c003570 con 0x7f9f9c003a60 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faf7fe700 1 -- 172.21.15.33:0/1167520499 reap_dead start 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9faeffd700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f9c003a60 0x7f9f9c003e30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009c00 tx=0x7f9fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88322e9d0c5e27a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000e710 con 0x7f9f9c003a60 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000e870 con 0x7f9f9c003a60 2024-08-15T17:56:58.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fae7fc700 1 -- 172.21.15.33:0/1167520499 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000ec30 con 0x7f9f9c003a60 2024-08-15T17:56:58.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 -- 172.21.15.33:0/1167520499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f9c003a60 msgr2=0x7f9f9c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f9c003a60 0x7f9f9c003e30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009c00 tx=0x7f9fa00091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 -- 172.21.15.33:0/1167520499 shutdown_connections 2024-08-15T17:56:58.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/1167520499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f9c003a60 0x7f9f9c003e30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 -- 172.21.15.33:0/1167520499 >> 172.21.15.33:0/1167520499 conn(0x7f9fb00c9bf0 msgr2=0x7f9fb006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:58.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 -- 172.21.15.33:0/1167520499 shutdown_connections 2024-08-15T17:56:58.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.892+0000 7f9fb55a6700 1 -- 172.21.15.33:0/1167520499 wait complete. 2024-08-15T17:56:58.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 Processor -- start 2024-08-15T17:56:58.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 -- start start 2024-08-15T17:56:58.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c003a60 0x7f9fb0164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00a8ba0 0x7f9fb00a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 0x7f9fb00b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00a6280 con 0x7f9fb00b0b40 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00a6b20 con 0x7f9fb00a8ba0 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fb55a6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00a9550 con 0x7f9f9c003a60 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9faf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 0x7f9fb00b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9faf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 0x7f9fb00b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52576/0 (socket says 172.21.15.33:52576) 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9faf7fe700 1 -- 172.21.15.33:0/2754296038 learned_addr learned my addr 172.21.15.33:0/2754296038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9fa67fc700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00a8ba0 0x7f9fb00a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.896+0000 7f9faeffd700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c003a60 0x7f9fb0164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9faf7fe700 1 -- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c003a60 msgr2=0x7f9fb0164420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9faf7fe700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c003a60 0x7f9fb0164420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9faf7fe700 1 -- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00a8ba0 msgr2=0x7f9fb00a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:58.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9faf7fe700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00a8ba0 0x7f9fb00a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:58.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9faf7fe700 1 -- 172.21.15.33:0/2754296038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00b1910 con 0x7f9fb00b0b40 2024-08-15T17:56:58.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9faf7fe700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 0x7f9fb00b0fb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fb006d9a0 tx=0x7f9fa80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800eec0 con 0x7f9fb00b0b40 2024-08-15T17:56:58.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa800c750 con 0x7f9fb00b0b40 2024-08-15T17:56:58.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb00a64d0 con 0x7f9fb00b0b40 2024-08-15T17:56:58.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800cb10 con 0x7f9fb00b0b40 2024-08-15T17:56:58.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb00b14f0 con 0x7f9fb00b0b40 2024-08-15T17:56:58.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb00645c0 con 0x7f9fb00b0b40 2024-08-15T17:56:58.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.900+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9fa801d460 con 0x7f9fb00b0b40 2024-08-15T17:56:58.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.904+0000 7f9fa77fe700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f90060860 0x7f9f90062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:58.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.904+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9fa807cc80 con 0x7f9fb00b0b40 2024-08-15T17:56:58.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.904+0000 7f9faeffd700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f90060860 0x7f9f90062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:58.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.904+0000 7f9faeffd700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f90060860 0x7f9f90062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00091e0 tx=0x7f9fa001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:58.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:58.908+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9fa804cce0 con 0x7f9fb00b0b40 2024-08-15T17:56:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.072+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.data", "var": "pg_num"} v 0) v1 -- 0x7f9fb00a6c60 con 0x7f9fb00b0b40 2024-08-15T17:56:59.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.072+0000 7f9fa77fe700 1 -- 172.21.15.33:0/2754296038 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.data", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f9fa8050300 con 0x7f9fb00b0b40 2024-08-15T17:56:59.074 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:56:59.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f90060860 msgr2=0x7f9f90062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f90060860 0x7f9f90062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00091e0 tx=0x7f9fa001a000 comp rx=0 tx=0).stop 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 msgr2=0x7f9fb00b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 0x7f9fb00b0fb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fb006d9a0 tx=0x7f9fa80016d0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 shutdown_connections 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f9f90060860 0x7f9f90062d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00a8ba0 0x7f9fb00a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fb00b0b40 0x7f9fb00b0fb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 --2- 172.21.15.33:0/2754296038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9c003a60 0x7f9fb0164420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 >> 172.21.15.33:0/2754296038 conn(0x7f9fb00c9bf0 msgr2=0x7f9fb00c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 shutdown_connections 2024-08-15T17:56:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.076+0000 7f9fb55a6700 1 -- 172.21.15.33:0/2754296038 wait complete. 2024-08-15T17:56:59.089 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:56:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 Processor -- start 2024-08-15T17:56:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- start start 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b0d20 0x7fa39406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa39406e450 0x7fa3940b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa394141a00 con 0x7fa3940b1630 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39406e8a0 con 0x7fa39406e450 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa394140b10 con 0x7fa3940b0d20 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa39406e450 0x7fa3940b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3937fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa3940b1630 0x7fa3941610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52628/0 (socket says 172.21.15.33:52628) 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa39406e450 0x7fa3940b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52580/0 (socket says 172.21.15.33:52580) 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3937fe700 1 -- 172.21.15.33:0/2561190940 learned_addr learned my addr 172.21.15.33:0/2561190940 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa392ffd700 1 --2- 172.21.15.33:0/2561190940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b0d20 0x7fa39406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 -- 172.21.15.33:0/2561190940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b0d20 msgr2=0x7fa39406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 --2- 172.21.15.33:0/2561190940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b0d20 0x7fa39406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 -- 172.21.15.33:0/2561190940 >> v1:172.21.15.33:6789/0 conn(0x7fa3940b1630 legacy=0x7fa3941610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa391ffb700 1 -- 172.21.15.33:0/2561190940 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316300982 0 0) 0x7fa394141a00 con 0x7fa3940b1630 2024-08-15T17:56:59.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 -- 172.21.15.33:0/2561190940 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394140df0 con 0x7fa39406e450 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa3927fc700 1 --2- 172.21.15.33:0/2561190940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa39406e450 0x7fa3940b10f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009e60 tx=0x7fa38c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce2e52b74dded8b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa391ffb700 1 -- 172.21.15.33:0/2561190940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00e070 con 0x7fa39406e450 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa391ffb700 1 -- 172.21.15.33:0/2561190940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00bb60 con 0x7fa39406e450 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa391ffb700 1 -- 172.21.15.33:0/2561190940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c012430 con 0x7fa39406e450 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- 172.21.15.33:0/2561190940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa39406e450 msgr2=0x7fa3940b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 --2- 172.21.15.33:0/2561190940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa39406e450 0x7fa3940b10f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009e60 tx=0x7fa38c009780 comp rx=0 tx=0).stop 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- 172.21.15.33:0/2561190940 shutdown_connections 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 --2- 172.21.15.33:0/2561190940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa39406e450 0x7fa3940b10f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 --2- 172.21.15.33:0/2561190940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b0d20 0x7fa39406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.200+0000 7fa393fff700 1 -- 172.21.15.33:0/2561190940 >> 172.21.15.33:0/2561190940 conn(0x7fa3940678d0 msgr2=0x7fa394067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:59.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 -- 172.21.15.33:0/2561190940 shutdown_connections 2024-08-15T17:56:59.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 -- 172.21.15.33:0/2561190940 wait complete. 2024-08-15T17:56:59.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 Processor -- start 2024-08-15T17:56:59.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 -- start start 2024-08-15T17:56:59.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa39406e450 0x7fa39413fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 0x7fa3940a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b1630 0x7fa3940a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940a79e0 con 0x7fa3940b0d20 2024-08-15T17:56:59.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940a6e40 con 0x7fa39406e450 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa393fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940a70b0 con 0x7fa3940b1630 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 0x7fa3940a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 0x7fa3940a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52590/0 (socket says 172.21.15.33:52590) 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 -- 172.21.15.33:0/2480094609 learned_addr learned my addr 172.21.15.33:0/2480094609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3937fe700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b1630 0x7fa3940a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa392ffd700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa39406e450 0x7fa39413fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 -- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b1630 msgr2=0x7fa3940a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b1630 0x7fa3940a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 -- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa39406e450 msgr2=0x7fa39413fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa39406e450 0x7fa39413fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.204+0000 7fa3927fc700 1 -- 172.21.15.33:0/2480094609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c009a20 con 0x7fa3940b0d20 2024-08-15T17:56:59.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa3927fc700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 0x7fa3940a9a80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00b6c0 tx=0x7fa38c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c012cb0 con 0x7fa3940b0d20 2024-08-15T17:56:59.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c012e30 con 0x7fa3940b0d20 2024-08-15T17:56:59.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3940a7390 con 0x7fa3940b0d20 2024-08-15T17:56:59.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0276c0 con 0x7fa3940b0d20 2024-08-15T17:56:59.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa394140300 con 0x7fa3940b0d20 2024-08-15T17:56:59.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa394140520 con 0x7fa3940b0d20 2024-08-15T17:56:59.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.208+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa38c024070 con 0x7fa3940b0d20 2024-08-15T17:56:59.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.212+0000 7fa38affd700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa374060860 0x7fa374062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.212+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa38c07f4d0 con 0x7fa3940b0d20 2024-08-15T17:56:59.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.212+0000 7fa392ffd700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa374060860 0x7fa374062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.212+0000 7fa392ffd700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa374060860 0x7fa374062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009db0 tx=0x7fa37c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.220+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa38c04f530 con 0x7fa3940b0d20 2024-08-15T17:56:59.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.420+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3940a7b90 con 0x7fa3940b0d20 2024-08-15T17:56:59.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.420+0000 7fa38affd700 1 -- 172.21.15.33:0/2480094609 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5684 (secure 0 0 0) 0x7fa3940a7b90 con 0x7fa3940b0d20 2024-08-15T17:56:59.421 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:56:59.422 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:39.333104+0000","modified":"2024-08-15T17:54:42.968502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5002":{"gid":5002,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2964556950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2964556950},{"type":"v1","addr":"172.21.15.105:6837","nonce":2964556950}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:56:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa374060860 msgr2=0x7fa374062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa374060860 0x7fa374062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009db0 tx=0x7fa37c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 msgr2=0x7fa3940a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 0x7fa3940a9a80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00b6c0 tx=0x7fa38c019000 comp rx=0 tx=0).stop 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 shutdown_connections 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa374060860 0x7fa374062d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3940b1630 0x7fa3940a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3940b0d20 0x7fa3940a9a80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 --2- 172.21.15.33:0/2480094609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa39406e450 0x7fa39413fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 >> 172.21.15.33:0/2480094609 conn(0x7fa3940678d0 msgr2=0x7fa39415db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 shutdown_connections 2024-08-15T17:56:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.424+0000 7fa393fff700 1 -- 172.21.15.33:0/2480094609 wait complete. 2024-08-15T17:56:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-08-15T17:56:59.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:56:59.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.548+0000 7fad62560700 1 Processor -- start 2024-08-15T17:56:59.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.548+0000 7fad62560700 1 -- start start 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad5c0cb560 0x7fad5c161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0cbaa0 con 0x7fad5c154900 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c157630 con 0x7fad5c0b14a0 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c068790 con 0x7fad5c0cb560 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad6155e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fad5c154900 0x7fad5c0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52632/0 (socket says 172.21.15.33:52632) 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad6155e700 1 -- 172.21.15.33:0/149802880 learned_addr learned my addr 172.21.15.33:0/149802880 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad61d5f700 1 --2- 172.21.15.33:0/149802880 >> v2:172.21.15.105:3300/0 conn(0x7fad5c0cb560 0x7fad5c161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad53fff700 1 -- 172.21.15.33:0/149802880 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118009490 0 0) 0x7fad5c0cbaa0 con 0x7fad5c154900 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad53fff700 1 -- 172.21.15.33:0/149802880 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad48003570 con 0x7fad5c154900 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad61d5f700 1 -- 172.21.15.33:0/149802880 >> v1:172.21.15.105:6789/0 conn(0x7fad5c0b14a0 legacy=0x7fad5c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad61d5f700 1 -- 172.21.15.33:0/149802880 >> v1:172.21.15.33:6789/0 conn(0x7fad5c154900 legacy=0x7fad5c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad61d5f700 1 -- 172.21.15.33:0/149802880 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c157910 con 0x7fad5c0cb560 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad61d5f700 1 --2- 172.21.15.33:0/149802880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c0cb560 0x7fad5c161ad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fad54009e60 tx=0x7fad54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c457e13239a70857 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad53fff700 1 -- 172.21.15.33:0/149802880 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400e070 con 0x7fad5c0cb560 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad53fff700 1 -- 172.21.15.33:0/149802880 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400bb60 con 0x7fad5c0cb560 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad53fff700 1 -- 172.21.15.33:0/149802880 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54012430 con 0x7fad5c0cb560 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- 172.21.15.33:0/149802880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c0cb560 msgr2=0x7fad5c161ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 --2- 172.21.15.33:0/149802880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c0cb560 0x7fad5c161ad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fad54009e60 tx=0x7fad54009780 comp rx=0 tx=0).stop 2024-08-15T17:56:59.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- 172.21.15.33:0/149802880 shutdown_connections 2024-08-15T17:56:59.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 --2- 172.21.15.33:0/149802880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c0cb560 0x7fad5c161ad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- 172.21.15.33:0/149802880 >> 172.21.15.33:0/149802880 conn(0x7fad5c0678d0 msgr2=0x7fad5c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:59.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- 172.21.15.33:0/149802880 shutdown_connections 2024-08-15T17:56:59.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.552+0000 7fad62560700 1 -- 172.21.15.33:0/149802880 wait complete. 2024-08-15T17:56:59.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 Processor -- start 2024-08-15T17:56:59.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 -- start start 2024-08-15T17:56:59.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 0x7fad5c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5c0cb560 0x7fad5c0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c154900 0x7fad5c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0b0ab0 con 0x7fad5c0b14a0 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0afea0 con 0x7fad5c154900 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0b0180 con 0x7fad5c0cb560 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 0x7fad5c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 0x7fad5c150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52606/0 (socket says 172.21.15.33:52606) 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 -- 172.21.15.33:0/1256867884 learned_addr learned my addr 172.21.15.33:0/1256867884 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad60d5d700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5c0cb560 0x7fad5c0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad61d5f700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c154900 0x7fad5c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 -- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5c0cb560 msgr2=0x7fad5c0af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5c0cb560 0x7fad5c0af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 -- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c154900 msgr2=0x7fad5c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c154900 0x7fad5c159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 -- 172.21.15.33:0/1256867884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009a20 con 0x7fad5c0b14a0 2024-08-15T17:56:59.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad6155e700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 0x7fad5c150a10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fad5800c590 tx=0x7fad58007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58005b30 con 0x7fad5c0b14a0 2024-08-15T17:56:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58005cb0 con 0x7fad5c0b14a0 2024-08-15T17:56:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c0b0460 con 0x7fad5c0b14a0 2024-08-15T17:56:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58007320 con 0x7fad5c0b14a0 2024-08-15T17:56:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.556+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c150f50 con 0x7fad5c0b14a0 2024-08-15T17:56:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.560+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c06af50 con 0x7fad5c0b14a0 2024-08-15T17:56:59.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.560+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fad5801b3b0 con 0x7fad5c0b14a0 2024-08-15T17:56:59.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.560+0000 7fad517fa700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fad40060860 0x7fad40062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.560+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fad5807c3e0 con 0x7fad5c0b14a0 2024-08-15T17:56:59.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.560+0000 7fad60d5d700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fad40060860 0x7fad40062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.564+0000 7fad60d5d700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fad40060860 0x7fad40062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0ab350 tx=0x7fad4c000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.568+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fad5c06af50 con 0x7fad5c0b14a0 2024-08-15T17:56:59.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.728+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad5c15afd0 con 0x7fad5c0b14a0 2024-08-15T17:56:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.732+0000 7fad517fa700 1 -- 172.21.15.33:0/1256867884 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18789 (secure 0 0 0) 0x7fad5804c440 con 0x7fad5c0b14a0 2024-08-15T17:56:59.733 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:56:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:55:32.481799+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.1a","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:56:59.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fad40060860 msgr2=0x7fad40062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fad40060860 0x7fad40062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0ab350 tx=0x7fad4c000bc0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 msgr2=0x7fad5c150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 0x7fad5c150a10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fad5800c590 tx=0x7fad58007e00 comp rx=0 tx=0).stop 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 shutdown_connections 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fad40060860 0x7fad40062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5c154900 0x7fad5c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5c0cb560 0x7fad5c0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 --2- 172.21.15.33:0/1256867884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad5c0b14a0 0x7fad5c150a10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 >> 172.21.15.33:0/1256867884 conn(0x7fad5c0678d0 msgr2=0x7fad5c1539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 shutdown_connections 2024-08-15T17:56:59.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.736+0000 7fad62560700 1 -- 172.21.15.33:0/1256867884 wait complete. 2024-08-15T17:56:59.753 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-15T17:56:59.753 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:56:59.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 Processor -- start 2024-08-15T17:56:59.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 -- start start 2024-08-15T17:56:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe2cc154900 0x7fe2cc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0b12d0 0x7fe2cc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0cbaa0 con 0x7fe2cc0cb390 2024-08-15T17:56:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc068790 con 0x7fe2cc154900 2024-08-15T17:56:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1583f0 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe2cc0cb390 0x7fe2cc06df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52638/0 (socket says 172.21.15.33:52638) 2024-08-15T17:56:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2ca59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe2cc154900 0x7fe2cc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2cad9d700 1 -- 172.21.15.33:0/589624288 learned_addr learned my addr 172.21.15.33:0/589624288 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:56:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2c3fff700 1 --2- 172.21.15.33:0/589624288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0b12d0 0x7fe2cc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2c9d9b700 1 -- 172.21.15.33:0/589624288 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236454234 0 0) 0x7fe2cc0cbaa0 con 0x7fe2cc0cb390 2024-08-15T17:56:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.860+0000 7fe2c9d9b700 1 -- 172.21.15.33:0/589624288 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b8003570 con 0x7fe2cc0cb390 2024-08-15T17:56:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c3fff700 1 -- 172.21.15.33:0/589624288 >> v2:172.21.15.33:3300/0 conn(0x7fe2cc154900 msgr2=0x7fe2cc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:56:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c3fff700 1 --2- 172.21.15.33:0/589624288 >> v2:172.21.15.33:3300/0 conn(0x7fe2cc154900 0x7fe2cc0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c3fff700 1 -- 172.21.15.33:0/589624288 >> v1:172.21.15.33:6789/0 conn(0x7fe2cc0cb390 legacy=0x7fe2cc06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c3fff700 1 -- 172.21.15.33:0/589624288 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0b1700 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2ca59c700 1 --2- 172.21.15.33:0/589624288 >> v2:172.21.15.33:3300/0 conn(0x7fe2cc154900 0x7fe2cc0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:56:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c3fff700 1 --2- 172.21.15.33:0/589624288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0b12d0 0x7fe2cc0cae50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40098e0 tx=0x7fe2b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc43948b808f2120 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c9d9b700 1 -- 172.21.15.33:0/589624288 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011630 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c9d9b700 1 -- 172.21.15.33:0/589624288 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4011790 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2c9d9b700 1 -- 172.21.15.33:0/589624288 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011b10 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 -- 172.21.15.33:0/589624288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0b12d0 msgr2=0x7fe2cc0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/589624288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0b12d0 0x7fe2cc0cae50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40098e0 tx=0x7fe2b40091a0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 -- 172.21.15.33:0/589624288 shutdown_connections 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/589624288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0b12d0 0x7fe2cc0cae50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/589624288 >> v2:172.21.15.33:3300/0 conn(0x7fe2cc154900 0x7fe2cc0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 -- 172.21.15.33:0/589624288 >> 172.21.15.33:0/589624288 conn(0x7fe2cc0678d0 msgr2=0x7fe2cc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 -- 172.21.15.33:0/589624288 shutdown_connections 2024-08-15T17:56:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.864+0000 7fe2cb59e700 1 -- 172.21.15.33:0/589624288 wait complete. 2024-08-15T17:56:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 Processor -- start 2024-08-15T17:56:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 -- start start 2024-08-15T17:56:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 0x7fe2cc141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0cb390 0x7fe2cc0a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2cc154900 0x7fe2cc155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0a7c00 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc142370 con 0x7fe2cc154900 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0a6ff0 con 0x7fe2cc0cb390 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 0x7fe2cc141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 0x7fe2cc141e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52634/0 (socket says 172.21.15.33:52634) 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 -- 172.21.15.33:0/1662532946 learned_addr learned my addr 172.21.15.33:0/1662532946 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cad9d700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2cc154900 0x7fe2cc155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2c3fff700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0cb390 0x7fe2cc0a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 -- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0cb390 msgr2=0x7fe2cc0a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0cb390 0x7fe2cc0a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 -- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2cc154900 msgr2=0x7fe2cc155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2cc154900 0x7fe2cc155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 -- 172.21.15.33:0/1662532946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc009420 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2ca59c700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 0x7fe2cc141e30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00ec80 tx=0x7fe2bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00c920 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc00ca80 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4009420 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.868+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00ce00 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.872+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc0a75b0 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.872+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc0643a0 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.872+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe2bc013680 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.872+0000 7fe2c27fc700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe2ac060860 0x7fe2ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:56:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.872+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe2bc07d6e0 con 0x7fe2cc0b12d0 2024-08-15T17:56:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.872+0000 7fe2c3fff700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe2ac060860 0x7fe2ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:56:59.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.876+0000 7fe2c3fff700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe2ac060860 0x7fe2ac062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40093f0 tx=0x7fe2b4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:56:59.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:56:59.880+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe2bc04d740 con 0x7fe2cc0b12d0 2024-08-15T17:57:00.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.076+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2cc06f5f0 con 0x7fe2cc0b12d0 2024-08-15T17:57:00.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2c27fc700 1 -- 172.21.15.33:0/1662532946 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5684 (secure 0 0 0) 0x7fe2bc050d60 con 0x7fe2cc0b12d0 2024-08-15T17:57:00.082 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:00.082 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:39.333104+0000","modified":"2024-08-15T17:54:42.968502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5002":{"gid":5002,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2964556950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2964556950},{"type":"v1","addr":"172.21.15.105:6837","nonce":2964556950}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:57:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe2ac060860 msgr2=0x7fe2ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe2ac060860 0x7fe2ac062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40093f0 tx=0x7fe2b4017000 comp rx=0 tx=0).stop 2024-08-15T17:57:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 msgr2=0x7fe2cc141e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 0x7fe2cc141e30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00ec80 tx=0x7fe2bc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 shutdown_connections 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe2ac060860 0x7fe2ac062d10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2cc154900 0x7fe2cc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2cc0cb390 0x7fe2cc0a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 --2- 172.21.15.33:0/1662532946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2cc0b12d0 0x7fe2cc141e30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 >> 172.21.15.33:0/1662532946 conn(0x7fe2cc0678d0 msgr2=0x7fe2cc063720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 shutdown_connections 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.080+0000 7fe2cb59e700 1 -- 172.21.15.33:0/1662532946 wait complete. 2024-08-15T17:57:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-08-15T17:57:00.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:57:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 Processor -- start 2024-08-15T17:57:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 -- start start 2024-08-15T17:57:00.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2b9006e620 0x7f2b900b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b900b1630 0x7f2b90141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b90141a00 con 0x7f2b900b0d20 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b90140b10 con 0x7f2b9006e620 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b953c8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b90140df0 con 0x7f2b900b1630 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b8ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2b900b0d20 0x7f2b9006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52646/0 (socket says 172.21.15.33:52646) 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b8ffff700 1 -- 172.21.15.33:0/2018361645 learned_addr learned my addr 172.21.15.33:0/2018361645 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b8f7fe700 1 --2- 172.21.15.33:0/2018361645 >> v2:172.21.15.105:3300/0 conn(0x7f2b9006e620 0x7f2b900b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b94bc7700 1 --2- 172.21.15.33:0/2018361645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b900b1630 0x7f2b90141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.204+0000 7f2b8effd700 1 -- 172.21.15.33:0/2018361645 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686251734 0 0) 0x7f2b90141a00 con 0x7f2b900b0d20 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b8effd700 1 -- 172.21.15.33:0/2018361645 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b70003570 con 0x7f2b900b0d20 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b94bc7700 1 -- 172.21.15.33:0/2018361645 >> v2:172.21.15.105:3300/0 conn(0x7f2b9006e620 msgr2=0x7f2b900b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b94bc7700 1 --2- 172.21.15.33:0/2018361645 >> v2:172.21.15.105:3300/0 conn(0x7f2b9006e620 0x7f2b900b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b94bc7700 1 -- 172.21.15.33:0/2018361645 >> v1:172.21.15.33:6789/0 conn(0x7f2b900b0d20 legacy=0x7f2b9006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b94bc7700 1 -- 172.21.15.33:0/2018361645 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b901410d0 con 0x7f2b900b1630 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b94bc7700 1 --2- 172.21.15.33:0/2018361645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b900b1630 0x7f2b90141e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098e0 tx=0x7f2b880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b313e126f02c9d server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b8effd700 1 -- 172.21.15.33:0/2018361645 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88011630 con 0x7f2b900b1630 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b8effd700 1 -- 172.21.15.33:0/2018361645 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88011790 con 0x7f2b900b1630 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b8effd700 1 -- 172.21.15.33:0/2018361645 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88011b10 con 0x7f2b900b1630 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 -- 172.21.15.33:0/2018361645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b900b1630 msgr2=0x7f2b90141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 --2- 172.21.15.33:0/2018361645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b900b1630 0x7f2b90141e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098e0 tx=0x7f2b880091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 -- 172.21.15.33:0/2018361645 shutdown_connections 2024-08-15T17:57:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 --2- 172.21.15.33:0/2018361645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b900b1630 0x7f2b90141e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 --2- 172.21.15.33:0/2018361645 >> v2:172.21.15.105:3300/0 conn(0x7f2b9006e620 0x7f2b900b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 -- 172.21.15.33:0/2018361645 >> 172.21.15.33:0/2018361645 conn(0x7f2b900678d0 msgr2=0x7f2b90067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 -- 172.21.15.33:0/2018361645 shutdown_connections 2024-08-15T17:57:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 -- 172.21.15.33:0/2018361645 wait complete. 2024-08-15T17:57:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 Processor -- start 2024-08-15T17:57:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.208+0000 7f2b953c8700 1 -- start start 2024-08-15T17:57:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b9006e620 0x7f2b900aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b900b0d20 0x7f2b9016e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 0x7f2b9013ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9016ed60 con 0x7f2b900b1630 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9016f060 con 0x7f2b900b0d20 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b90140490 con 0x7f2b9006e620 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 0x7f2b9013ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 0x7f2b9013ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52636/0 (socket says 172.21.15.33:52636) 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 -- 172.21.15.33:0/3885885215 learned_addr learned my addr 172.21.15.33:0/3885885215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b8f7fe700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b900b0d20 0x7f2b9016e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b8ffff700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b9006e620 0x7f2b900aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 -- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b9006e620 msgr2=0x7f2b900aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b9006e620 0x7f2b900aa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 -- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b900b0d20 msgr2=0x7f2b9016e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b900b0d20 0x7f2b9016e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 -- 172.21.15.33:0/3885885215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009420 con 0x7f2b900b1630 2024-08-15T17:57:00.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b8f7fe700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b900b0d20 0x7f2b9016e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:00.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b94bc7700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 0x7f2b9013ff50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009ed0 tx=0x7f2b88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88011b10 con 0x7f2b900b1630 2024-08-15T17:57:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88027450 con 0x7f2b900b1630 2024-08-15T17:57:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9016f2d0 con 0x7f2b900b1630 2024-08-15T17:57:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880277f0 con 0x7f2b900b1630 2024-08-15T17:57:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.212+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9016f890 con 0x7f2b900b1630 2024-08-15T17:57:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.216+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2b880303f0 con 0x7f2b900b1630 2024-08-15T17:57:00.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.216+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b900643a0 con 0x7f2b900b1630 2024-08-15T17:57:00.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.216+0000 7f2b87fff700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2b74060860 0x7f2b74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.216+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2b8807efe0 con 0x7f2b900b1630 2024-08-15T17:57:00.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.216+0000 7f2b8ffff700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2b74060860 0x7f2b74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.216+0000 7f2b8ffff700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2b74060860 0x7f2b74062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b80007fd0 tx=0x7f2b80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.224+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2b8804efc0 con 0x7f2b900b1630 2024-08-15T17:57:00.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.428+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b9006f5f0 con 0x7f2b900b1630 2024-08-15T17:57:00.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.428+0000 7f2b87fff700 1 -- 172.21.15.33:0/3885885215 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f2b880525e0 con 0x7f2b900b1630 2024-08-15T17:57:00.429 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:00.429 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:39.333104+0000","modified":"2024-08-15T17:54:42.968502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5002":{"gid":5002,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2964556950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2964556950},{"type":"v1","addr":"172.21.15.105:6837","nonce":2964556950}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:57:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.428+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2b74060860 msgr2=0x7f2b74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.428+0000 7f2b953c8700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2b74060860 0x7f2b74062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b80007fd0 tx=0x7f2b80009040 comp rx=0 tx=0).stop 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.428+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 msgr2=0x7f2b9013ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.428+0000 7f2b953c8700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 0x7f2b9013ff50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009ed0 tx=0x7f2b88017000 comp rx=0 tx=0).stop 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 shutdown_connections 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2b74060860 0x7f2b74062d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b900b0d20 0x7f2b9016e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b900b1630 0x7f2b9013ff50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 --2- 172.21.15.33:0/3885885215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b9006e620 0x7f2b900aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 >> 172.21.15.33:0/3885885215 conn(0x7f2b900678d0 msgr2=0x7f2b9015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:00.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 shutdown_connections 2024-08-15T17:57:00.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.432+0000 7f2b953c8700 1 -- 172.21.15.33:0/3885885215 wait complete. 2024-08-15T17:57:00.433 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-08-15T17:57:00.444 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:57:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.552+0000 7fd84937e700 1 Processor -- start 2024-08-15T17:57:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.552+0000 7fd84937e700 1 -- start start 2024-08-15T17:57:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd8440ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8440cae50 0x7fd84415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440ca510 con 0x7fd844142780 2024-08-15T17:57:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440cb290 con 0x7fd8440cae50 2024-08-15T17:57:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c9900 con 0x7fd844142b50 2024-08-15T17:57:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd83b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd8440ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd843fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd844142780 0x7fd8440ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:45346/0 (socket says 172.21.15.33:45346) 2024-08-15T17:57:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd843fff700 1 -- 172.21.15.33:0/2223903356 learned_addr learned my addr 172.21.15.33:0/2223903356 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd848b7d700 1 --2- 172.21.15.33:0/2223903356 >> v2:172.21.15.105:3300/0 conn(0x7fd8440cae50 0x7fd84415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd8437fe700 1 -- 172.21.15.33:0/2223903356 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284256576 0 0) 0x7fd8440ca510 con 0x7fd844142780 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd8437fe700 1 -- 172.21.15.33:0/2223903356 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd830003570 con 0x7fd844142780 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd83b7fe700 1 -- 172.21.15.33:0/2223903356 >> v2:172.21.15.105:3300/0 conn(0x7fd8440cae50 msgr2=0x7fd84415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd83b7fe700 1 --2- 172.21.15.33:0/2223903356 >> v2:172.21.15.105:3300/0 conn(0x7fd8440cae50 0x7fd84415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd83b7fe700 1 -- 172.21.15.33:0/2223903356 >> v1:172.21.15.105:6789/0 conn(0x7fd844142780 legacy=0x7fd8440ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd83b7fe700 1 -- 172.21.15.33:0/2223903356 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440c9be0 con 0x7fd844142b50 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd83b7fe700 1 --2- 172.21.15.33:0/2223903356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd8440ca910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0098e0 tx=0x7fd82c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400d101033001cec server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd8437fe700 1 -- 172.21.15.33:0/2223903356 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011630 con 0x7fd844142b50 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd8437fe700 1 -- 172.21.15.33:0/2223903356 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c011790 con 0x7fd844142b50 2024-08-15T17:57:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd8437fe700 1 -- 172.21.15.33:0/2223903356 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011b10 con 0x7fd844142b50 2024-08-15T17:57:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- 172.21.15.33:0/2223903356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 msgr2=0x7fd8440ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 --2- 172.21.15.33:0/2223903356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd8440ca910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0098e0 tx=0x7fd82c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- 172.21.15.33:0/2223903356 shutdown_connections 2024-08-15T17:57:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 --2- 172.21.15.33:0/2223903356 >> v2:172.21.15.105:3300/0 conn(0x7fd8440cae50 0x7fd84415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 --2- 172.21.15.33:0/2223903356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd8440ca910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- 172.21.15.33:0/2223903356 >> 172.21.15.33:0/2223903356 conn(0x7fd84406e070 msgr2=0x7fd8440b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- 172.21.15.33:0/2223903356 shutdown_connections 2024-08-15T17:57:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.556+0000 7fd84937e700 1 -- 172.21.15.33:0/2223903356 wait complete. 2024-08-15T17:57:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 Processor -- start 2024-08-15T17:57:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 -- start start 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8440cae50 0x7fd8440c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 0x7fd8440c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd844169550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c6820 con 0x7fd844142780 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c6b00 con 0x7fd8440cae50 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd84937e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c6de0 con 0x7fd844142b50 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 0x7fd8440c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 0x7fd8440c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52640/0 (socket says 172.21.15.33:52640) 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd848b7d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd844169550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd843fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8440cae50 0x7fd8440c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 -- 172.21.15.33:0/1184892210 learned_addr learned my addr 172.21.15.33:0/1184892210 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 -- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 msgr2=0x7fd844169550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd844169550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 -- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8440cae50 msgr2=0x7fd8440c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8440cae50 0x7fd8440c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 -- 172.21.15.33:0/1184892210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009420 con 0x7fd844142780 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd83b7fe700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 0x7fd8440c8ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd8440c9a40 tx=0x7fd82c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.560+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011900 con 0x7fd844142780 2024-08-15T17:57:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c011a80 con 0x7fd844142780 2024-08-15T17:57:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440c70c0 con 0x7fd844142780 2024-08-15T17:57:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c01a680 con 0x7fd844142780 2024-08-15T17:57:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440c91e0 con 0x7fd844142780 2024-08-15T17:57:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8440c75a0 con 0x7fd844142780 2024-08-15T17:57:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd82c01aa30 con 0x7fd844142780 2024-08-15T17:57:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd840ff9700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd824060860 0x7fd824062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.564+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd82c07eab0 con 0x7fd844142780 2024-08-15T17:57:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.568+0000 7fd843fff700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd824060860 0x7fd824062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.568+0000 7fd843fff700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd824060860 0x7fd824062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd834007fd0 tx=0x7fd834009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.576+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd82c04eb10 con 0x7fd844142780 2024-08-15T17:57:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.744+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8440638f0 con 0x7fd844142780 2024-08-15T17:57:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd840ff9700 1 -- 172.21.15.33:0/1184892210 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18789 (secure 0 0 0) 0x7fd82c015090 con 0x7fd844142780 2024-08-15T17:57:00.748 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:00.749 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:55:32.481799+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-15T17:54:37.596331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-15T17:54:38.323771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.1a","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd824060860 msgr2=0x7fd824062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd824060860 0x7fd824062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd834007fd0 tx=0x7fd834009040 comp rx=0 tx=0).stop 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 msgr2=0x7fd8440c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 0x7fd8440c8ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd8440c9a40 tx=0x7fd82c017000 comp rx=0 tx=0).stop 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 shutdown_connections 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd824060860 0x7fd824062d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd844142b50 0x7fd844169550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd844142780 0x7fd8440c8ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 --2- 172.21.15.33:0/1184892210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8440cae50 0x7fd8440c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 >> 172.21.15.33:0/1184892210 conn(0x7fd84406e070 msgr2=0x7fd8440b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 shutdown_connections 2024-08-15T17:57:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.748+0000 7fd84937e700 1 -- 172.21.15.33:0/1184892210 wait complete. 2024-08-15T17:57:00.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-15T17:57:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.868+0000 7f26fa7c1700 1 Processor -- start 2024-08-15T17:57:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- start start 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26f4154900 0x7f26f40b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26f40b12d0 0x7f26f40cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40b1730 con 0x7f26f40cb390 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f4068790 con 0x7f26f40b12d0 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f41583f0 con 0x7f26f4154900 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26f40b12d0 0x7f26f40cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26f40b12d0 0x7f26f40cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52646/0 (socket says 172.21.15.33:52646) 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 -- 172.21.15.33:0/2399634819 learned_addr learned my addr 172.21.15.33:0/2399634819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f97bf700 1 --2- 172.21.15.33:0/2399634819 >> v2:172.21.15.105:3300/0 conn(0x7f26f4154900 0x7f26f40b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 -- 172.21.15.33:0/2399634819 >> v2:172.21.15.105:3300/0 conn(0x7f26f4154900 msgr2=0x7f26f40b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 --2- 172.21.15.33:0/2399634819 >> v2:172.21.15.105:3300/0 conn(0x7f26f4154900 0x7f26f40b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 -- 172.21.15.33:0/2399634819 >> v1:172.21.15.33:6789/0 conn(0x7f26f40cb390 legacy=0x7f26f406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 -- 172.21.15.33:0/2399634819 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40cbaa0 con 0x7f26f40b12d0 2024-08-15T17:57:00.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f97bf700 1 --2- 172.21.15.33:0/2399634819 >> v2:172.21.15.105:3300/0 conn(0x7f26f4154900 0x7f26f40b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26f8fbe700 1 --2- 172.21.15.33:0/2399634819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f40cae50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f26f4064e60 tx=0x7f26e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8044e6a0562464c server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26ebfff700 1 -- 172.21.15.33:0/2399634819 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400b860 con 0x7f26f40b12d0 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26ebfff700 1 -- 172.21.15.33:0/2399634819 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400b9c0 con 0x7f26f40b12d0 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26ebfff700 1 -- 172.21.15.33:0/2399634819 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400bd60 con 0x7f26f40b12d0 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- 172.21.15.33:0/2399634819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 msgr2=0x7f26f40cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/2399634819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f40cae50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f26f4064e60 tx=0x7f26e4009250 comp rx=0 tx=0).stop 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- 172.21.15.33:0/2399634819 shutdown_connections 2024-08-15T17:57:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/2399634819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f40cae50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/2399634819 >> v2:172.21.15.105:3300/0 conn(0x7f26f4154900 0x7f26f40b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- 172.21.15.33:0/2399634819 >> 172.21.15.33:0/2399634819 conn(0x7f26f40678d0 msgr2=0x7f26f4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- 172.21.15.33:0/2399634819 shutdown_connections 2024-08-15T17:57:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.872+0000 7f26fa7c1700 1 -- 172.21.15.33:0/2399634819 wait complete. 2024-08-15T17:57:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.876+0000 7f26fa7c1700 1 Processor -- start 2024-08-15T17:57:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.876+0000 7f26fa7c1700 1 -- start start 2024-08-15T17:57:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f4150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26f40cb390 0x7f26f4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4154900 0x7f26f406a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f406a0d0 con 0x7f26f40b12d0 2024-08-15T17:57:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40694c0 con 0x7f26f4154900 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40697a0 con 0x7f26f40cb390 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f4150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f4150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52656/0 (socket says 172.21.15.33:52656) 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 -- 172.21.15.33:0/3408722387 learned_addr learned my addr 172.21.15.33:0/3408722387 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f8fbe700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26f40cb390 0x7f26f4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f9fc0700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4154900 0x7f26f406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 -- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26f40cb390 msgr2=0x7f26f4159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26f40cb390 0x7f26f4159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 -- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4154900 msgr2=0x7f26f406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4154900 0x7f26f406a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 -- 172.21.15.33:0/3408722387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e40094f0 con 0x7f26f40b12d0 2024-08-15T17:57:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f8fbe700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26f40cb390 0x7f26f4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26f97bf700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f4150da0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c830 tx=0x7f26f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011600 con 0x7f26f40b12d0 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0011760 con 0x7f26f40b12d0 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f4069a80 con 0x7f26f40b12d0 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011b20 con 0x7f26f40b12d0 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.880+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f41512e0 con 0x7f26f40b12d0 2024-08-15T17:57:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.884+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f40643a0 con 0x7f26f40b12d0 2024-08-15T17:57:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.884+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f26f000a3e0 con 0x7f26f40b12d0 2024-08-15T17:57:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.884+0000 7f26e97fa700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26d8060860 0x7f26d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.884+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f26f007d5a0 con 0x7f26f40b12d0 2024-08-15T17:57:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.884+0000 7f26f8fbe700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26d8060860 0x7f26d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.884+0000 7f26f8fbe700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26d8060860 0x7f26d8062d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26f4064e60 tx=0x7f26e4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:00.892+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f26f004d560 con 0x7f26f40b12d0 2024-08-15T17:57:01.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.100+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f26f4153bb0 con 0x7f26f40b12d0 2024-08-15T17:57:01.102 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-08-15T17:57:01.100+0000 7f11dc36e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-15T17:57:01.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.108+0000 7f26e97fa700 1 -- 172.21.15.33:0/3408722387 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f26f0050b80 con 0x7f26f40b12d0 2024-08-15T17:57:01.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26d8060860 msgr2=0x7f26d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26d8060860 0x7f26d8062d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26f4064e60 tx=0x7f26e4017000 comp rx=0 tx=0).stop 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 msgr2=0x7f26f4150da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f4150da0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c830 tx=0x7f26f0008040 comp rx=0 tx=0).stop 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 shutdown_connections 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f26d8060860 0x7f26d8062d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4154900 0x7f26f406a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26f40cb390 0x7f26f4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 --2- 172.21.15.33:0/3408722387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f40b12d0 0x7f26f4150da0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 >> 172.21.15.33:0/3408722387 conn(0x7f26f40678d0 msgr2=0x7f26f406da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 shutdown_connections 2024-08-15T17:57:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.112+0000 7f26fa7c1700 1 -- 172.21.15.33:0/3408722387 wait complete. 2024-08-15T17:57:01.115 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-15T17:57:01.118 INFO:tasks.ceph.mds.d.smithi105.stderr: -7316> 2024-08-15T17:54:43.668+0000 7f965158f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-15T17:57:01.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-15T17:57:01.146 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-08-15T17:57:01.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62d96700 1 Processor -- start 2024-08-15T17:57:01.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62d96700 1 -- start start 2024-08-15T17:57:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62d96700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1b5c0b14a0 0x7f1b5c157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62d96700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c06e010 con 0x7f1b5c1514d0 2024-08-15T17:57:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62d96700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c157fb0 con 0x7f1b5c1574f0 2024-08-15T17:57:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62d96700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c158290 con 0x7f1b5c0b14a0 2024-08-15T17:57:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b61d94700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1b5c1514d0 0x7f1b5c06ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52660/0 (socket says 172.21.15.33:52660) 2024-08-15T17:57:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b61d94700 1 -- 172.21.15.33:0/1418394385 learned_addr learned my addr 172.21.15.33:0/1418394385 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62595700 1 --2- 172.21.15.33:0/1418394385 >> v2:172.21.15.105:3300/0 conn(0x7f1b5c0b14a0 0x7f1b5c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b60d92700 1 -- 172.21.15.33:0/1418394385 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123980864 0 0) 0x7f1b5c06e010 con 0x7f1b5c1514d0 2024-08-15T17:57:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b60d92700 1 -- 172.21.15.33:0/1418394385 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b48003570 con 0x7f1b5c1514d0 2024-08-15T17:57:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62595700 1 -- 172.21.15.33:0/1418394385 >> v1:172.21.15.105:6789/0 conn(0x7f1b5c1574f0 legacy=0x7f1b5c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62595700 1 -- 172.21.15.33:0/1418394385 >> v1:172.21.15.33:6789/0 conn(0x7f1b5c1514d0 legacy=0x7f1b5c06ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62595700 1 -- 172.21.15.33:0/1418394385 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c06e260 con 0x7f1b5c0b14a0 2024-08-15T17:57:01.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b62595700 1 --2- 172.21.15.33:0/1418394385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c157970 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009e60 tx=0x7f1b54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc7170fd05cac88 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b60d92700 1 -- 172.21.15.33:0/1418394385 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400e070 con 0x7f1b5c0b14a0 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b60d92700 1 -- 172.21.15.33:0/1418394385 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400bb60 con 0x7f1b5c0b14a0 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.236+0000 7f1b60d92700 1 -- 172.21.15.33:0/1418394385 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54012430 con 0x7f1b5c0b14a0 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- 172.21.15.33:0/1418394385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 msgr2=0x7f1b5c157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 --2- 172.21.15.33:0/1418394385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c157970 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009e60 tx=0x7f1b54009780 comp rx=0 tx=0).stop 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- 172.21.15.33:0/1418394385 shutdown_connections 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 --2- 172.21.15.33:0/1418394385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c157970 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- 172.21.15.33:0/1418394385 >> 172.21.15.33:0/1418394385 conn(0x7f1b5c0678a0 msgr2=0x7f1b5c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- 172.21.15.33:0/1418394385 shutdown_connections 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- 172.21.15.33:0/1418394385 wait complete. 2024-08-15T17:57:01.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 Processor -- start 2024-08-15T17:57:01.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- start start 2024-08-15T17:57:01.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c168f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 0x7f1b5c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b5c1574f0 0x7f1b5c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c154440 con 0x7f1b5c1514d0 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0a9990 con 0x7f1b5c0b14a0 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62d96700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c169540 con 0x7f1b5c1574f0 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 0x7f1b5c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 0x7f1b5c1506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52666/0 (socket says 172.21.15.33:52666) 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61d94700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c168f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 -- 172.21.15.33:0/3648738988 learned_addr learned my addr 172.21.15.33:0/3648738988 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b62595700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b5c1574f0 0x7f1b5c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 -- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b5c1574f0 msgr2=0x7f1b5c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b5c1574f0 0x7f1b5c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 -- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 msgr2=0x7f1b5c168f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c168f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 -- 172.21.15.33:0/3648738988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54009a20 con 0x7f1b5c1514d0 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.240+0000 7f1b61593700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 0x7f1b5c1506f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00c4e0 tx=0x7f1b4c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c011590 con 0x7f1b5c1514d0 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c011710 con 0x7f1b5c1514d0 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c169820 con 0x7f1b5c1514d0 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c011ad0 con 0x7f1b5c1514d0 2024-08-15T17:57:01.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c169de0 con 0x7f1b5c1514d0 2024-08-15T17:57:01.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c0a9b40 con 0x7f1b5c1514d0 2024-08-15T17:57:01.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.244+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1b4c01b3b0 con 0x7f1b5c1514d0 2024-08-15T17:57:01.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.248+0000 7f1b51ffb700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1b40060890 0x7f1b40062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:01.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.248+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f1b4c07c650 con 0x7f1b5c1514d0 2024-08-15T17:57:01.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.248+0000 7f1b61d94700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1b40060890 0x7f1b40062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:01.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.248+0000 7f1b61d94700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1b40060890 0x7f1b40062d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1b58007fd0 tx=0x7f1b58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:01.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.252+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1b4c04c650 con 0x7f1b5c1514d0 2024-08-15T17:57:01.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:01.452+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b5c0a9b00 con 0x7f1b5c1514d0 2024-08-15T17:57:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.108+0000 7f1b51ffb700 1 -- 172.21.15.33:0/3648738988 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b4c0170a0 con 0x7f1b5c1514d0 2024-08-15T17:57:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1b40060890 msgr2=0x7f1b40062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1b40060890 0x7f1b40062d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1b58007fd0 tx=0x7f1b58009040 comp rx=0 tx=0).stop 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 msgr2=0x7f1b5c1506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 0x7f1b5c1506f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00c4e0 tx=0x7f1b4c00c7f0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 shutdown_connections 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f1b40060890 0x7f1b40062d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b5c1574f0 0x7f1b5c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b5c1514d0 0x7f1b5c1506f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 --2- 172.21.15.33:0/3648738988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b5c0b14a0 0x7f1b5c168f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 >> 172.21.15.33:0/3648738988 conn(0x7f1b5c0678a0 msgr2=0x7f1b5c155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 shutdown_connections 2024-08-15T17:57:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.116+0000 7f1b62d96700 1 -- 172.21.15.33:0/3648738988 wait complete. 2024-08-15T17:57:02.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-15T17:57:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.256+0000 7ff01abe9700 1 Processor -- start 2024-08-15T17:57:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.256+0000 7ff01abe9700 1 -- start start 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff0140b2e90 0x7ff0140c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0140c5b40 con 0x7ff0140cded0 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0140b2aa0 con 0x7ff0140b26d0 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0140b3310 con 0x7ff0140b2e90 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01a3e8700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff0140cded0 0x7ff0140ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52662/0 (socket says 172.21.15.33:52662) 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01a3e8700 1 -- 172.21.15.33:0/3267642551 learned_addr learned my addr 172.21.15.33:0/3267642551 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff0193e6700 1 --2- 172.21.15.33:0/3267642551 >> v2:172.21.15.105:3300/0 conn(0x7ff0140b2e90 0x7ff0140c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff018be5700 1 -- 172.21.15.33:0/3267642551 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879049135 0 0) 0x7ff0140c5b40 con 0x7ff0140cded0 2024-08-15T17:57:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff018be5700 1 -- 172.21.15.33:0/3267642551 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff000003570 con 0x7ff0140cded0 2024-08-15T17:57:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff0193e6700 1 -- 172.21.15.33:0/3267642551 >> v1:172.21.15.105:6789/0 conn(0x7ff0140b26d0 legacy=0x7ff0140c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff018be5700 1 -- 172.21.15.33:0/3267642551 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1487019352 0 0) 0x7ff000003570 con 0x7ff0140cded0 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff0193e6700 1 -- 172.21.15.33:0/3267642551 >> v1:172.21.15.33:6789/0 conn(0x7ff0140cded0 legacy=0x7ff0140ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff0193e6700 1 -- 172.21.15.33:0/3267642551 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014159820 con 0x7ff0140b2e90 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff0193e6700 1 --2- 172.21.15.33:0/3267642551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140b2e90 0x7ff0140c66e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff010009900 tx=0x7ff010009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d744ab16dd69a6f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff018be5700 1 -- 172.21.15.33:0/3267642551 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0017f0 con 0x7ff0140b2e90 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff018be5700 1 -- 172.21.15.33:0/3267642551 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff010011420 con 0x7ff0140b2e90 2024-08-15T17:57:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff018be5700 1 -- 172.21.15.33:0/3267642551 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100117a0 con 0x7ff0140b2e90 2024-08-15T17:57:02.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- 172.21.15.33:0/3267642551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140b2e90 msgr2=0x7ff0140c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 --2- 172.21.15.33:0/3267642551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140b2e90 0x7ff0140c66e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff010009900 tx=0x7ff010009120 comp rx=0 tx=0).stop 2024-08-15T17:57:02.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- 172.21.15.33:0/3267642551 shutdown_connections 2024-08-15T17:57:02.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 --2- 172.21.15.33:0/3267642551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140b2e90 0x7ff0140c66e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- 172.21.15.33:0/3267642551 >> 172.21.15.33:0/3267642551 conn(0x7ff014067590 msgr2=0x7ff0140d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- 172.21.15.33:0/3267642551 shutdown_connections 2024-08-15T17:57:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.260+0000 7ff01abe9700 1 -- 172.21.15.33:0/3267642551 wait complete. 2024-08-15T17:57:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 Processor -- start 2024-08-15T17:57:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 -- start start 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 0x7ff01416c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0140b2e90 0x7ff014169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140cded0 0x7ff0140cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01409c4b0 con 0x7ff0140b26d0 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01409ca30 con 0x7ff0140cded0 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01416a0e0 con 0x7ff0140b2e90 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 0x7ff01416c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 0x7ff01416c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52670/0 (socket says 172.21.15.33:52670) 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 -- 172.21.15.33:0/2121887338 learned_addr learned my addr 172.21.15.33:0/2121887338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01a3e8700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140cded0 0x7ff0140cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff0193e6700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0140b2e90 0x7ff014169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 -- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0140b2e90 msgr2=0x7ff014169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0140b2e90 0x7ff014169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 -- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140cded0 msgr2=0x7ff0140cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140cded0 0x7ff0140cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 -- 172.21.15.33:0/2121887338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100093c0 con 0x7ff0140b26d0 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff019be7700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 0x7ff01416c130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c590 tx=0x7ff008007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008016070 con 0x7ff0140b26d0 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0140cc010 con 0x7ff0140b26d0 2024-08-15T17:57:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008006820 con 0x7ff0140b26d0 2024-08-15T17:57:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008006bc0 con 0x7ff0140b26d0 2024-08-15T17:57:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.264+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01409ace0 con 0x7ff0140b26d0 2024-08-15T17:57:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.268+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0140644b0 con 0x7ff0140b26d0 2024-08-15T17:57:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.268+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff008006fd0 con 0x7ff0140b26d0 2024-08-15T17:57:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.268+0000 7ff005ffb700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7feff8060860 0x7feff8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.268+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6805+0+0 (secure 0 0 0) 0x7ff00807c7b0 con 0x7ff0140b26d0 2024-08-15T17:57:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.268+0000 7ff0193e6700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7feff8060860 0x7feff8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.268+0000 7ff0193e6700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7feff8060860 0x7feff8062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff010009850 tx=0x7ff010016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.280+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff00804c710 con 0x7ff0140b26d0 2024-08-15T17:57:02.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:02.448+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff01409c780 con 0x7ff0140b26d0 2024-08-15T17:57:03.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.120+0000 7ff005ffb700 1 -- 172.21.15.33:0/2121887338 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff00804fd30 con 0x7ff0140b26d0 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7feff8060860 msgr2=0x7feff8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7feff8060860 0x7feff8062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff010009850 tx=0x7ff010016000 comp rx=0 tx=0).stop 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 msgr2=0x7ff01416c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 0x7ff01416c130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c590 tx=0x7ff008007f50 comp rx=0 tx=0).stop 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 shutdown_connections 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7feff8060860 0x7feff8062d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0140cded0 0x7ff0140cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0140b2e90 0x7ff014169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 --2- 172.21.15.33:0/2121887338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0140b26d0 0x7ff01416c130 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 >> 172.21.15.33:0/2121887338 conn(0x7ff014067590 msgr2=0x7ff0140cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:03.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 shutdown_connections 2024-08-15T17:57:03.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.128+0000 7ff01abe9700 1 -- 172.21.15.33:0/2121887338 wait complete. 2024-08-15T17:57:03.131 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-08-15T17:57:03.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-15T17:57:03.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 Processor -- start 2024-08-15T17:57:03.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 -- start start 2024-08-15T17:57:03.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f45c8155f90 0x7f45c80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:03.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80c8c00 0x7f45c80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:03.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c80ac470 con 0x7f45c8156360 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c80ab860 con 0x7f45c8155f90 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cf1da700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80abb40 con 0x7f45c80c8c00 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45ccf76700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f45c8155f90 0x7f45c80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45c7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f45c8156360 0x7f45c80ac900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52678/0 (socket says 172.21.15.33:52678) 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45c7fff700 1 -- 172.21.15.33:0/3718102266 learned_addr learned my addr 172.21.15.33:0/3718102266 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45cd777700 1 --2- 172.21.15.33:0/3718102266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80c8c00 0x7f45c80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45ccf76700 1 -- 172.21.15.33:0/3718102266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80c8c00 msgr2=0x7f45c80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45ccf76700 1 --2- 172.21.15.33:0/3718102266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80c8c00 0x7f45c80686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45ccf76700 1 -- 172.21.15.33:0/3718102266 >> v1:172.21.15.33:6789/0 conn(0x7f45c8156360 legacy=0x7f45c80ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45c77fe700 1 -- 172.21.15.33:0/3718102266 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993150653 0 0) 0x7f45c80ac470 con 0x7f45c8156360 2024-08-15T17:57:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45ccf76700 1 -- 172.21.15.33:0/3718102266 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c80abe20 con 0x7f45c8155f90 2024-08-15T17:57:03.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45ccf76700 1 --2- 172.21.15.33:0/3718102266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80c86c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0098e0 tx=0x7f45bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d903e7dc3aca4a55 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.252+0000 7f45c77fe700 1 -- 172.21.15.33:0/3718102266 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc009e80 con 0x7f45c8155f90 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45c77fe700 1 -- 172.21.15.33:0/3718102266 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00b8f0 con 0x7f45c8155f90 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45c77fe700 1 -- 172.21.15.33:0/3718102266 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00bc70 con 0x7f45c8155f90 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- 172.21.15.33:0/3718102266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 msgr2=0x7f45c80c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3718102266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80c86c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0098e0 tx=0x7f45bc0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- 172.21.15.33:0/3718102266 shutdown_connections 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3718102266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80c8c00 0x7f45c80686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3718102266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80c86c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- 172.21.15.33:0/3718102266 >> 172.21.15.33:0/3718102266 conn(0x7f45c806d9f0 msgr2=0x7f45c806ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- 172.21.15.33:0/3718102266 shutdown_connections 2024-08-15T17:57:03.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- 172.21.15.33:0/3718102266 wait complete. 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 Processor -- start 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- start start 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45c80c8c00 0x7f45c8153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80afdb0 0x7f45c80cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80ca680 con 0x7f45c8155f90 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80caee0 con 0x7f45c80c8c00 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cf1da700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80aa7d0 con 0x7f45c80afdb0 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52692/0 (socket says 172.21.15.33:52692) 2024-08-15T17:57:03.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45c7fff700 1 -- 172.21.15.33:0/3505964300 learned_addr learned my addr 172.21.15.33:0/3505964300 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45cd777700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80afdb0 0x7f45c80cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.256+0000 7f45ccf76700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45c80c8c00 0x7f45c8153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c7fff700 1 -- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80afdb0 msgr2=0x7f45c80cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c7fff700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80afdb0 0x7f45c80cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c7fff700 1 -- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45c80c8c00 msgr2=0x7f45c8153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c7fff700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45c80c8c00 0x7f45c8153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c7fff700 1 -- 172.21.15.33:0/3505964300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009420 con 0x7f45c8155f90 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45cd777700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80afdb0 0x7f45c80cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c7fff700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80af870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c5b0 tx=0x7f45b4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4005b30 con 0x7f45c8155f90 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4005c90 con 0x7f45c8155f90 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c80ca890 con 0x7f45c8155f90 2024-08-15T17:57:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4007300 con 0x7f45c8155f90 2024-08-15T17:57:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c8154440 con 0x7f45c8155f90 2024-08-15T17:57:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c80b1b10 con 0x7f45c8155f90 2024-08-15T17:57:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.260+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f45b401b3b0 con 0x7f45c8155f90 2024-08-15T17:57:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.264+0000 7f45c4ff9700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45ac060860 0x7f45ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.264+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6367+0+0 (secure 0 0 0) 0x7f45b407c370 con 0x7f45c8155f90 2024-08-15T17:57:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.264+0000 7f45ccf76700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45ac060860 0x7f45ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:03.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.264+0000 7f45ccf76700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45ac060860 0x7f45ac062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0091e0 tx=0x7f45bc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:03.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.272+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f45c80b1b10 con 0x7f45c8155f90 2024-08-15T17:57:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:03.440+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45c80b1b10 con 0x7f45c8155f90 2024-08-15T17:57:04.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.124+0000 7f45c4ff9700 1 -- 172.21.15.33:0/3505964300 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f45c80b1b10 con 0x7f45c8155f90 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45ac060860 msgr2=0x7f45ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45ac060860 0x7f45ac062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0091e0 tx=0x7f45bc017000 comp rx=0 tx=0).stop 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 msgr2=0x7f45c80af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80af870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c5b0 tx=0x7f45b4001070 comp rx=0 tx=0).stop 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 shutdown_connections 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f45ac060860 0x7f45ac062d10 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0091e0 tx=0x7f45bc017000 comp rx=0 tx=0).stop 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45c80afdb0 0x7f45c80cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45c8155f90 0x7f45c80af870 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 --2- 172.21.15.33:0/3505964300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45c80c8c00 0x7f45c8153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 >> 172.21.15.33:0/3505964300 conn(0x7f45c806d9f0 msgr2=0x7f45c8152850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:04.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 shutdown_connections 2024-08-15T17:57:04.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.128+0000 7f45cf1da700 1 -- 172.21.15.33:0/3505964300 wait complete. 2024-08-15T17:57:04.132 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-08-15T17:57:04.145 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:57:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.248+0000 7f6302d8b700 1 Processor -- start 2024-08-15T17:57:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.248+0000 7f6302d8b700 1 -- start start 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6302d8b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 0x7f62fc0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6302d8b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f62fc0b07d0 0x7f62fc0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6302d8b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc0b0cd0 con 0x7f62fc1590a0 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6302d8b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc0b0fb0 con 0x7f62fc0b07d0 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6302d8b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0b1290 con 0x7f62fc159470 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6301d89700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f62fc1590a0 0x7f62fc0adda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52690/0 (socket says 172.21.15.33:52690) 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6301d89700 1 -- 172.21.15.33:0/2462107922 learned_addr learned my addr 172.21.15.33:0/2462107922 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 --2- 172.21.15.33:0/2462107922 >> v2:172.21.15.33:3300/0 conn(0x7f62fc0b07d0 0x7f62fc0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073872697 0 0) 0x7f62fc0b0cd0 con 0x7f62fc1590a0 2024-08-15T17:57:04.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e8003570 con 0x7f62fc1590a0 2024-08-15T17:57:04.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6301588700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 0x7f62fc0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4259613296 0 0) 0x7f62e8003570 con 0x7f62fc1590a0 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 msgr2=0x7f62fc0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 0x7f62fc0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 >> v2:172.21.15.33:3300/0 conn(0x7f62fc0b07d0 msgr2=0x7f62fc0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 --2- 172.21.15.33:0/2462107922 >> v2:172.21.15.33:3300/0 conn(0x7f62fc0b07d0 0x7f62fc0b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0b1570 con 0x7f62fc1590a0 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f62f4001810 con 0x7f62fc1590a0 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 --2- 172.21.15.33:0/2462107922 >> v2:172.21.15.33:3300/0 conn(0x7f62fc0b07d0 0x7f62fc0b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 >> v1:172.21.15.33:6789/0 conn(0x7f62fc1590a0 legacy=0x7f62fc0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 0x7f62e8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8003fe0 0x7f62e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e8004d50 0x7f62e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0b0fb0 con 0x7f62e8004d50 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0b1290 con 0x7f62e8003fe0 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800ba90 con 0x7f62fc159470 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e8004d50 0x7f62e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6301d89700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 0x7f62e8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6301588700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8003fe0 0x7f62e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 -- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 msgr2=0x7f62e8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc159470 0x7f62e8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 -- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8003fe0 msgr2=0x7f62e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8003fe0 0x7f62e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 -- 172.21.15.33:0/2462107922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8003570 con 0x7f62e8004d50 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6301588700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8003fe0 0x7f62e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f630258a700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e8004d50 0x7f62e80051c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0b0c00 tx=0x7f62f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf09644b074310a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8009740 con 0x7f62e8004d50 2024-08-15T17:57:04.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f800e8c0 con 0x7f62e8004d50 2024-08-15T17:57:04.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.252+0000 7f6300d87700 1 -- 172.21.15.33:0/2462107922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800ec60 con 0x7f62e8004d50 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- 172.21.15.33:0/2462107922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e8004d50 msgr2=0x7f62e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 --2- 172.21.15.33:0/2462107922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e8004d50 0x7f62e80051c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0b0c00 tx=0x7f62f80091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f630258a700 1 -- 172.21.15.33:0/2462107922 reap_dead start 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- 172.21.15.33:0/2462107922 shutdown_connections 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- 172.21.15.33:0/2462107922 >> 172.21.15.33:0/2462107922 conn(0x7f62fc0c9840 msgr2=0x7f62fc0c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- 172.21.15.33:0/2462107922 shutdown_connections 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- 172.21.15.33:0/2462107922 wait complete. 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 Processor -- start 2024-08-15T17:57:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- start start 2024-08-15T17:57:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62fc0c2cb0 0x7f62fc0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc0c1d40 0x7f62fc16a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 0x7f62fc14c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc16a640 con 0x7f62fc0a7610 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0aa490 con 0x7f62fc0c2cb0 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.256+0000 7f6302d8b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0aa700 con 0x7f62fc0c1d40 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 0x7f62fc14c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 0x7f62fc14c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52716/0 (socket says 172.21.15.33:52716) 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 -- 172.21.15.33:0/1327044391 learned_addr learned my addr 172.21.15.33:0/1327044391 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6301d89700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62fc0c2cb0 0x7f62fc0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6301588700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc0c1d40 0x7f62fc16a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 -- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc0c1d40 msgr2=0x7f62fc16a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc0c1d40 0x7f62fc16a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 -- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62fc0c2cb0 msgr2=0x7f62fc0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62fc0c2cb0 0x7f62fc0c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 -- 172.21.15.33:0/1327044391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0aa9e0 con 0x7f62fc0a7610 2024-08-15T17:57:04.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6301588700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc0c1d40 0x7f62fc16a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:04.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f630258a700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 0x7f62fc14c4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f62f8016000 tx=0x7f62f801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8022070 con 0x7f62fc0a7610 2024-08-15T17:57:04.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc0aacc0 con 0x7f62fc0a7610 2024-08-15T17:57:04.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8009740 con 0x7f62fc0a7610 2024-08-15T17:57:04.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc0c2220 con 0x7f62fc0a7610 2024-08-15T17:57:04.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f801c660 con 0x7f62fc0a7610 2024-08-15T17:57:04.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc0aaeb0 con 0x7f62fc0a7610 2024-08-15T17:57:04.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f62f801ca50 con 0x7f62fc0a7610 2024-08-15T17:57:04.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f62f1ffb700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f62e0060860 0x7f62e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f62f8000e40 con 0x7f62fc0a7610 2024-08-15T17:57:04.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.260+0000 7f6301d89700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f62e0060860 0x7f62e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.264+0000 7f6301d89700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f62e0060860 0x7f62e0062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a170 tx=0x7f62f4006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.272+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f62f804ee30 con 0x7f62fc0a7610 2024-08-15T17:57:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.440+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62fc0638f0 con 0x7f62fc0a7610 2024-08-15T17:57:04.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.440+0000 7f62f1ffb700 1 -- 172.21.15.33:0/1327044391 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15514 (secure 0 0 0) 0x7f62f8052450 con 0x7f62fc0a7610 2024-08-15T17:57:04.442 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:04.442 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":42,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:57:04.117559+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6837/2964556950":"2024-08-16T17:57:01.104153+0000","172.21.15.105:6835/2964556950":"2024-08-16T17:57:01.104153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f62e0060860 msgr2=0x7f62e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f62e0060860 0x7f62e0062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a170 tx=0x7f62f4006040 comp rx=0 tx=0).stop 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 msgr2=0x7f62fc14c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 0x7f62fc14c4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f62f8016000 tx=0x7f62f801a000 comp rx=0 tx=0).stop 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 shutdown_connections 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f62e0060860 0x7f62e0062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62fc0a7610 0x7f62fc14c4a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62fc0c1d40 0x7f62fc16a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 --2- 172.21.15.33:0/1327044391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62fc0c2cb0 0x7f62fc0c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 >> 172.21.15.33:0/1327044391 conn(0x7f62fc0c9840 msgr2=0x7f62fc0a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 shutdown_connections 2024-08-15T17:57:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.444+0000 7f6302d8b700 1 -- 172.21.15.33:0/1327044391 wait complete. 2024-08-15T17:57:04.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-15T17:53:36.292795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000657299.meta', 'create_time': '2024-08-15T17:54:52.374842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000657299'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000657299.data', 'create_time': '2024-08-15T17:54:53.390917+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000657299'}}}] 2024-08-15T17:57:04.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-15T17:57:04.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.572+0000 7f0ca7330700 1 Processor -- start 2024-08-15T17:57:04.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.572+0000 7f0ca7330700 1 -- start start 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0ca0156dc0 0x7f0ca00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ca00b3570 0x7f0ca0160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00afd40 con 0x7f0ca00b01d0 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00cc910 con 0x7f0ca00b3570 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00af130 con 0x7f0ca0156dc0 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca6b2f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ca00b3570 0x7f0ca0160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca5b2d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0ca00b01d0 0x7f0ca00b2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52694/0 (socket says 172.21.15.33:52694) 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca5b2d700 1 -- 172.21.15.33:0/2699755769 learned_addr learned my addr 172.21.15.33:0/2699755769 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca632e700 1 --2- 172.21.15.33:0/2699755769 >> v2:172.21.15.105:3300/0 conn(0x7f0ca0156dc0 0x7f0ca00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca532c700 1 -- 172.21.15.33:0/2699755769 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894162688 0 0) 0x7f0ca00afd40 con 0x7f0ca00b01d0 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca532c700 1 -- 172.21.15.33:0/2699755769 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c8c003570 con 0x7f0ca00b01d0 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/2699755769 >> v2:172.21.15.105:3300/0 conn(0x7f0ca0156dc0 msgr2=0x7f0ca00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca6b2f700 1 --2- 172.21.15.33:0/2699755769 >> v2:172.21.15.105:3300/0 conn(0x7f0ca0156dc0 0x7f0ca00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/2699755769 >> v1:172.21.15.33:6789/0 conn(0x7f0ca00b01d0 legacy=0x7f0ca00b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/2699755769 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00af410 con 0x7f0ca00b3570 2024-08-15T17:57:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca632e700 1 --2- 172.21.15.33:0/2699755769 >> v2:172.21.15.105:3300/0 conn(0x7f0ca0156dc0 0x7f0ca00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca6b2f700 1 --2- 172.21.15.33:0/2699755769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca00b3570 0x7f0ca0160ab0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00684a0 tx=0x7f0c98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6910f3a20b9406d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca532c700 1 -- 172.21.15.33:0/2699755769 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800e070 con 0x7f0ca00b3570 2024-08-15T17:57:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca532c700 1 -- 172.21.15.33:0/2699755769 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800bab0 con 0x7f0ca00b3570 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca532c700 1 -- 172.21.15.33:0/2699755769 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800be70 con 0x7f0ca00b3570 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- 172.21.15.33:0/2699755769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca00b3570 msgr2=0x7f0ca0160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 --2- 172.21.15.33:0/2699755769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca00b3570 0x7f0ca0160ab0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00684a0 tx=0x7f0c98009780 comp rx=0 tx=0).stop 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- 172.21.15.33:0/2699755769 shutdown_connections 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 --2- 172.21.15.33:0/2699755769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca00b3570 0x7f0ca0160ab0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 --2- 172.21.15.33:0/2699755769 >> v2:172.21.15.105:3300/0 conn(0x7f0ca0156dc0 0x7f0ca00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- 172.21.15.33:0/2699755769 >> 172.21.15.33:0/2699755769 conn(0x7f0ca00ce920 msgr2=0x7f0ca006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- 172.21.15.33:0/2699755769 shutdown_connections 2024-08-15T17:57:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.576+0000 7f0ca7330700 1 -- 172.21.15.33:0/2699755769 wait complete. 2024-08-15T17:57:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 Processor -- start 2024-08-15T17:57:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 -- start start 2024-08-15T17:57:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ca00b01d0 0x7f0ca00c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ca00b3570 0x7f0ca00c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 0x7f0ca00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c9370 con 0x7f0ca0156dc0 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c9650 con 0x7f0ca00b3570 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c9930 con 0x7f0ca00b01d0 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 0x7f0ca00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 0x7f0ca00687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52732/0 (socket says 172.21.15.33:52732) 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/797760442 learned_addr learned my addr 172.21.15.33:0/797760442 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca5b2d700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ca00b3570 0x7f0ca00c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca632e700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ca00b01d0 0x7f0ca00c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ca00b01d0 msgr2=0x7f0ca00c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ca00b01d0 0x7f0ca00c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ca00b3570 msgr2=0x7f0ca00c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ca00b3570 0x7f0ca00c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 -- 172.21.15.33:0/797760442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c009420 con 0x7f0ca0156dc0 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca6b2f700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 0x7f0ca00687a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0c980099f0 tx=0x7f0c98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98012dd0 con 0x7f0ca0156dc0 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98027470 con 0x7f0ca0156dc0 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98027830 con 0x7f0ca0156dc0 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c98009a20 con 0x7f0ca0156dc0 2024-08-15T17:57:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.580+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00c9ef0 con 0x7f0ca0156dc0 2024-08-15T17:57:04.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.584+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0064330 con 0x7f0ca0156dc0 2024-08-15T17:57:04.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.584+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0c98024070 con 0x7f0ca0156dc0 2024-08-15T17:57:04.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.584+0000 7f0c967fc700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0c84060860 0x7f0c84062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.584+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0c9807f310 con 0x7f0ca0156dc0 2024-08-15T17:57:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.584+0000 7f0ca632e700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0c84060860 0x7f0c84062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.584+0000 7f0ca632e700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0c84060860 0x7f0c84062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009ea0 tx=0x7f0c9c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.592+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0c9804f640 con 0x7f0ca0156dc0 2024-08-15T17:57:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ca0063bf0 con 0x7f0ca0156dc0 2024-08-15T17:57:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0c967fc700 1 -- 172.21.15.33:0/797760442 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c98052c60 con 0x7f0ca0156dc0 2024-08-15T17:57:04.756 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-15T17:57:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0c84060860 msgr2=0x7f0c84062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0c84060860 0x7f0c84062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009ea0 tx=0x7f0c9c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 msgr2=0x7f0ca00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 0x7f0ca00687a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0c980099f0 tx=0x7f0c98019000 comp rx=0 tx=0).stop 2024-08-15T17:57:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 shutdown_connections 2024-08-15T17:57:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0c84060860 0x7f0c84062d10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ca00b3570 0x7f0ca00c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0156dc0 0x7f0ca00687a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 --2- 172.21.15.33:0/797760442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ca00b01d0 0x7f0ca00c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 >> 172.21.15.33:0/797760442 conn(0x7f0ca00ce920 msgr2=0x7f0ca0151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 shutdown_connections 2024-08-15T17:57:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.756+0000 7f0ca7330700 1 -- 172.21.15.33:0/797760442 wait complete. 2024-08-15T17:57:04.771 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000657299.meta pg_num 2024-08-15T17:57:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.884+0000 7f6aeeec8700 1 Processor -- start 2024-08-15T17:57:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aeeec8700 1 -- start start 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aeeec8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ae81538e0 0x7f6ae80b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aeeec8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80b0ad0 con 0x7f6ae8153cb0 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aeeec8700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae815a940 con 0x7f6ae806f350 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aeeec8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80b01a0 con 0x7f6ae81538e0 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ae8153cb0 0x7f6ae806ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52706/0 (socket says 172.21.15.33:52706) 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adffff700 1 -- 172.21.15.33:0/3029244242 learned_addr learned my addr 172.21.15.33:0/3029244242 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aecc64700 1 --2- 172.21.15.33:0/3029244242 >> v2:172.21.15.105:3300/0 conn(0x7f6ae81538e0 0x7f6ae80b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775569521 0 0) 0x7f6ae80b0ad0 con 0x7f6ae8153cb0 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad0003570 con 0x7f6ae8153cb0 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100757381 0 0) 0x7f6ae815a940 con 0x7f6ae806f350 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae80b0ad0 con 0x7f6ae806f350 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aecc64700 1 -- 172.21.15.33:0/3029244242 >> v1:172.21.15.105:6789/0 conn(0x7f6ae806f350 legacy=0x7f6ae8159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aecc64700 1 -- 172.21.15.33:0/3029244242 >> v1:172.21.15.33:6789/0 conn(0x7f6ae8153cb0 legacy=0x7f6ae806ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aecc64700 1 -- 172.21.15.33:0/3029244242 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80b0480 con 0x7f6ae81538e0 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6aecc64700 1 --2- 172.21.15.33:0/3029244242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae80b0f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40098e0 tx=0x7f6ae40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b3c4c37fa7076d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4011630 con 0x7f6ae81538e0 2024-08-15T17:57:04.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4011790 con 0x7f6ae81538e0 2024-08-15T17:57:04.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.888+0000 7f6adf7fe700 1 -- 172.21.15.33:0/3029244242 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4011b30 con 0x7f6ae81538e0 2024-08-15T17:57:04.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3029244242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 msgr2=0x7f6ae80b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3029244242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae80b0f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40098e0 tx=0x7f6ae40091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3029244242 shutdown_connections 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3029244242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae80b0f60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3029244242 >> 172.21.15.33:0/3029244242 conn(0x7f6ae8066e00 msgr2=0x7f6ae8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3029244242 shutdown_connections 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3029244242 wait complete. 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 Processor -- start 2024-08-15T17:57:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- start start 2024-08-15T17:57:04.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 0x7f6ae8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae81696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae8153cb0 0x7f6ae8169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8158ea0 con 0x7f6ae806f350 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80c56b0 con 0x7f6ae81538e0 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aeeec8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81588e0 con 0x7f6ae8153cb0 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 0x7f6ae8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 0x7f6ae8157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52748/0 (socket says 172.21.15.33:52748) 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 -- 172.21.15.33:0/3090264682 learned_addr learned my addr 172.21.15.33:0/3090264682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6adffff700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae81696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aed465700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae8153cb0 0x7f6ae8169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 -- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae8153cb0 msgr2=0x7f6ae8169c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae8153cb0 0x7f6ae8169c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 -- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 msgr2=0x7f6ae81696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae81696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 -- 172.21.15.33:0/3090264682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009420 con 0x7f6ae806f350 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.892+0000 7f6aecc64700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 0x7f6ae8157ed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ed0 tx=0x7f6ae4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae401f070 con 0x7f6ae806f350 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4000bc0 con 0x7f6ae806f350 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8158bc0 con 0x7f6ae806f350 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4025420 con 0x7f6ae806f350 2024-08-15T17:57:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae8152640 con 0x7f6ae806f350 2024-08-15T17:57:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80645c0 con 0x7f6ae806f350 2024-08-15T17:57:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ae4023070 con 0x7f6ae806f350 2024-08-15T17:57:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adcff9700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ad4060860 0x7f6ad4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f6ae407de30 con 0x7f6ae806f350 2024-08-15T17:57:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.896+0000 7f6adffff700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ad4060860 0x7f6ad4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:04.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.900+0000 7f6adffff700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ad4060860 0x7f6ad4062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80add30 tx=0x7f6ad8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:04.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:04.904+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ae404e2c0 con 0x7f6ae806f350 2024-08-15T17:57:05.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.068+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.meta", "var": "pg_num"} v 0) v1 -- 0x7f6ae80aea50 con 0x7f6ae806f350 2024-08-15T17:57:05.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6adcff9700 1 -- 172.21.15.33:0/3090264682 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.meta", "var": "pg_num"}]=0 v42) v1 ==== 124+0+11 (secure 0 0 0) 0x7f6ae40150c0 con 0x7f6ae806f350 2024-08-15T17:57:05.072 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:57:05.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ad4060860 msgr2=0x7f6ad4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ad4060860 0x7f6ad4062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80add30 tx=0x7f6ad8009040 comp rx=0 tx=0).stop 2024-08-15T17:57:05.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 msgr2=0x7f6ae8157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 0x7f6ae8157ed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ed0 tx=0x7f6ae4017000 comp rx=0 tx=0).stop 2024-08-15T17:57:05.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 shutdown_connections 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6ad4060860 0x7f6ad4062d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae81538e0 0x7f6ae81696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae8153cb0 0x7f6ae8169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 --2- 172.21.15.33:0/3090264682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae806f350 0x7f6ae8157ed0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 >> 172.21.15.33:0/3090264682 conn(0x7f6ae8066e00 msgr2=0x7f6ae806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 shutdown_connections 2024-08-15T17:57:05.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.072+0000 7f6aeeec8700 1 -- 172.21.15.33:0/3090264682 wait complete. 2024-08-15T17:57:05.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000657299.data pg_num 2024-08-15T17:57:05.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.200+0000 7f3693fff700 1 Processor -- start 2024-08-15T17:57:05.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.200+0000 7f3693fff700 1 -- start start 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f369406a040 0x7f369413abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369413be40 con 0x7f3694156000 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369413d930 con 0x7f3694155c30 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369413b230 con 0x7f369406a040 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36927fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3694156000 0x7f369413a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52722/0 (socket says 172.21.15.33:52722) 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36927fc700 1 -- 172.21.15.33:0/743537003 learned_addr learned my addr 172.21.15.33:0/743537003 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36937fe700 1 --2- 172.21.15.33:0/743537003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f369406a040 0x7f369413abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096068676 0 0) 0x7f369413be40 con 0x7f3694156000 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3680003570 con 0x7f3694156000 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055722949 0 0) 0x7f369413d930 con 0x7f3694155c30 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369413be40 con 0x7f3694155c30 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287142356 0 0) 0x7f3680003570 con 0x7f3694156000 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36937fe700 1 -- 172.21.15.33:0/743537003 >> v1:172.21.15.105:6789/0 conn(0x7f3694155c30 legacy=0x7f3694069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36937fe700 1 -- 172.21.15.33:0/743537003 >> v1:172.21.15.33:6789/0 conn(0x7f3694156000 legacy=0x7f369413a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36937fe700 1 -- 172.21.15.33:0/743537003 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369413b510 con 0x7f369406a040 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f36937fe700 1 --2- 172.21.15.33:0/743537003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f369406a040 0x7f369413abd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f368c009e90 tx=0x7f368c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e85b9d448bf943c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00e070 con 0x7f369406a040 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00b870 con 0x7f369406a040 2024-08-15T17:57:05.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3691ffb700 1 -- 172.21.15.33:0/743537003 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c001470 con 0x7f369406a040 2024-08-15T17:57:05.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- 172.21.15.33:0/743537003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f369406a040 msgr2=0x7f369413abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 --2- 172.21.15.33:0/743537003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f369406a040 0x7f369413abd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f368c009e90 tx=0x7f368c009780 comp rx=0 tx=0).stop 2024-08-15T17:57:05.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- 172.21.15.33:0/743537003 shutdown_connections 2024-08-15T17:57:05.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 --2- 172.21.15.33:0/743537003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f369406a040 0x7f369413abd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- 172.21.15.33:0/743537003 >> 172.21.15.33:0/743537003 conn(0x7f369406e170 msgr2=0x7f369406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:05.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- 172.21.15.33:0/743537003 shutdown_connections 2024-08-15T17:57:05.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.204+0000 7f3693fff700 1 -- 172.21.15.33:0/743537003 wait complete. 2024-08-15T17:57:05.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 Processor -- start 2024-08-15T17:57:05.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 -- start start 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 0x7f36940ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3694155c30 0x7f369413a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3694156000 0x7f369413a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940adb30 con 0x7f369406a040 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940c9d30 con 0x7f3694156000 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3693fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369415b160 con 0x7f3694155c30 2024-08-15T17:57:05.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3692ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 0x7f36940ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f36927fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3694155c30 0x7f369413a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3692ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 0x7f36940ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52758/0 (socket says 172.21.15.33:52758) 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f36927fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3694155c30 0x7f369413a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:56948/0 (socket says 172.21.15.33:56948) 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f3692ffd700 1 -- 172.21.15.33:0/294784821 learned_addr learned my addr 172.21.15.33:0/294784821 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.208+0000 7f36937fe700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3694156000 0x7f369413a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3692ffd700 1 -- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3694155c30 msgr2=0x7f369413a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3692ffd700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3694155c30 0x7f369413a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3692ffd700 1 -- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3694156000 msgr2=0x7f369413a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3692ffd700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3694156000 0x7f369413a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3692ffd700 1 -- 172.21.15.33:0/294784821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c009a20 con 0x7f369406a040 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f36937fe700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3694156000 0x7f369413a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3692ffd700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 0x7f36940ae640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f368400c7c0 tx=0x7f3684007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684010510 con 0x7f369406a040 2024-08-15T17:57:05.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684010670 con 0x7f369406a040 2024-08-15T17:57:05.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369415ae80 con 0x7f369406a040 2024-08-15T17:57:05.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684010a10 con 0x7f369406a040 2024-08-15T17:57:05.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36940ca2c0 con 0x7f369406a040 2024-08-15T17:57:05.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.212+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36940638f0 con 0x7f369406a040 2024-08-15T17:57:05.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.216+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f368401b3b0 con 0x7f369406a040 2024-08-15T17:57:05.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.216+0000 7f368affd700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3674060860 0x7f3674062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.216+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f368407c420 con 0x7f369406a040 2024-08-15T17:57:05.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.216+0000 7f36927fc700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3674060860 0x7f3674062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.216+0000 7f36927fc700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3674060860 0x7f3674062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f36941550c0 tx=0x7f367c001620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.220+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f368404c7f0 con 0x7f369406a040 2024-08-15T17:57:05.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.388+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.data", "var": "pg_num"} v 0) v1 -- 0x7f3694069cb0 con 0x7f369406a040 2024-08-15T17:57:05.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.388+0000 7f368affd700 1 -- 172.21.15.33:0/294784821 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000657299.data", "var": "pg_num"}]=0 v42) v1 ==== 124+0+11 (secure 0 0 0) 0x7f368404fe10 con 0x7f369406a040 2024-08-15T17:57:05.390 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3674060860 msgr2=0x7f3674062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3674060860 0x7f3674062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f36941550c0 tx=0x7f367c001620 comp rx=0 tx=0).stop 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 msgr2=0x7f36940ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 0x7f36940ae640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f368400c7c0 tx=0x7f3684007e10 comp rx=0 tx=0).stop 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 shutdown_connections 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3674060860 0x7f3674062d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3694156000 0x7f369413a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3694155c30 0x7f369413a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 --2- 172.21.15.33:0/294784821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f369406a040 0x7f36940ae640 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 >> 172.21.15.33:0/294784821 conn(0x7f369406e170 msgr2=0x7f3694158490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 shutdown_connections 2024-08-15T17:57:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.396+0000 7f3693fff700 1 -- 172.21.15.33:0/294784821 wait complete. 2024-08-15T17:57:05.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:57:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2583fff700 1 Processor -- start 2024-08-15T17:57:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2583fff700 1 -- start start 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2583fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2584155d20 0x7f25840b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2583fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840af2b0 con 0x7f25840ad7c0 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2583fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840af590 con 0x7f258406df10 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2583fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25840adc10 con 0x7f2584155d20 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f25827fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f25840ad7c0 0x7f25840aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52736/0 (socket says 172.21.15.33:52736) 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f25827fc700 1 -- 172.21.15.33:0/119290580 learned_addr learned my addr 172.21.15.33:0/119290580 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2582ffd700 1 --2- 172.21.15.33:0/119290580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2584155d20 0x7f25840b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891143481 0 0) 0x7f25840af2b0 con 0x7f25840ad7c0 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2570003570 con 0x7f25840ad7c0 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279412444 0 0) 0x7f25840af590 con 0x7f258406df10 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25840af2b0 con 0x7f258406df10 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3838303074 0 0) 0x7f2570003570 con 0x7f25840ad7c0 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2582ffd700 1 -- 172.21.15.33:0/119290580 >> v1:172.21.15.105:6789/0 conn(0x7f258406df10 legacy=0x7f25841560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.512+0000 7f2582ffd700 1 -- 172.21.15.33:0/119290580 >> v1:172.21.15.33:6789/0 conn(0x7f25840ad7c0 legacy=0x7f25840aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2582ffd700 1 -- 172.21.15.33:0/119290580 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840af870 con 0x7f2584155d20 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2582ffd700 1 --2- 172.21.15.33:0/119290580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2584155d20 0x7f25840b0350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2574009910 tx=0x7f25740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9de42d4f699c83 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c001470 con 0x7f2584155d20 2024-08-15T17:57:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574011420 con 0x7f2584155d20 2024-08-15T17:57:05.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2581ffb700 1 -- 172.21.15.33:0/119290580 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740117c0 con 0x7f2584155d20 2024-08-15T17:57:05.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 -- 172.21.15.33:0/119290580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2584155d20 msgr2=0x7f25840b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 --2- 172.21.15.33:0/119290580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2584155d20 0x7f25840b0350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2574009910 tx=0x7f25740091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 -- 172.21.15.33:0/119290580 shutdown_connections 2024-08-15T17:57:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 --2- 172.21.15.33:0/119290580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2584155d20 0x7f25840b0350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 -- 172.21.15.33:0/119290580 >> 172.21.15.33:0/119290580 conn(0x7f25840678d0 msgr2=0x7f2584067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 -- 172.21.15.33:0/119290580 shutdown_connections 2024-08-15T17:57:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 -- 172.21.15.33:0/119290580 wait complete. 2024-08-15T17:57:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 Processor -- start 2024-08-15T17:57:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 -- start start 2024-08-15T17:57:05.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.516+0000 7f2583fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f258406df10 0x7f25840ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 0x7f258414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2584155d20 0x7f258416ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841507e0 con 0x7f25840ad7c0 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584151550 con 0x7f2584155d20 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25841509d0 con 0x7f258406df10 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 0x7f258414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 0x7f258414e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52768/0 (socket says 172.21.15.33:52768) 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 -- 172.21.15.33:0/3344185833 learned_addr learned my addr 172.21.15.33:0/3344185833 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2582ffd700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f258406df10 0x7f25840ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25837fe700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2584155d20 0x7f258416ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 -- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f258406df10 msgr2=0x7f25840ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f258406df10 0x7f25840ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 -- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2584155d20 msgr2=0x7f258416ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2584155d20 0x7f258416ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 -- 172.21.15.33:0/3344185833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009420 con 0x7f25840ad7c0 2024-08-15T17:57:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2582ffd700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f258406df10 0x7f25840ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f25827fc700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 0x7f258414e1d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f256c00cb70 tx=0x7f256c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c007e90 con 0x7f25840ad7c0 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c007360 con 0x7f25840ad7c0 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584150cb0 con 0x7f25840ad7c0 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c004830 con 0x7f25840ad7c0 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584151270 con 0x7f25840ad7c0 2024-08-15T17:57:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f256c004ba0 con 0x7f25840ad7c0 2024-08-15T17:57:05.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584152290 con 0x7f25840ad7c0 2024-08-15T17:57:05.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.520+0000 7f257affd700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2564060860 0x7f2564062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.524+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f256c07c400 con 0x7f25840ad7c0 2024-08-15T17:57:05.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.524+0000 7f2582ffd700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2564060860 0x7f2564062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.524+0000 7f2582ffd700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2564060860 0x7f2564062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f25740030c0 tx=0x7f2574016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.528+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2584152290 con 0x7f25840ad7c0 2024-08-15T17:57:05.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.728+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2584152290 con 0x7f25840ad7c0 2024-08-15T17:57:05.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.732+0000 7f257affd700 1 -- 172.21.15.33:0/3344185833 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f2584152290 con 0x7f25840ad7c0 2024-08-15T17:57:05.732 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:05.732 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3680521485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3680521485},{"type":"v1","addr":"172.21.15.105:6837","nonce":3680521485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:57:05.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2564060860 msgr2=0x7f2564062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2564060860 0x7f2564062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f25740030c0 tx=0x7f2574016000 comp rx=0 tx=0).stop 2024-08-15T17:57:05.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 msgr2=0x7f258414e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 0x7f258414e1d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f256c00cb70 tx=0x7f256c001b50 comp rx=0 tx=0).stop 2024-08-15T17:57:05.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 shutdown_connections 2024-08-15T17:57:05.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2564060860 0x7f2564062d10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2584155d20 0x7f258416ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25840ad7c0 0x7f258414e1d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 --2- 172.21.15.33:0/3344185833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f258406df10 0x7f25840ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 >> 172.21.15.33:0/3344185833 conn(0x7f25840678d0 msgr2=0x7f258414be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 shutdown_connections 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.736+0000 7f2583fff700 1 -- 172.21.15.33:0/3344185833 wait complete. 2024-08-15T17:57:05.738 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-08-15T17:57:05.754 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:57:05.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 Processor -- start 2024-08-15T17:57:05.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- start start 2024-08-15T17:57:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7a406e9d0 0x7fa7a406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a40b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40aba70 con 0x7fa7a4155010 2024-08-15T17:57:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40abd50 con 0x7fa7a406e9d0 2024-08-15T17:57:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40ac030 con 0x7fa7a40ab540 2024-08-15T17:57:05.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9595700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7a406e9d0 0x7fa7a406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9d96700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa7a4155010 0x7fa7a4155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52742/0 (socket says 172.21.15.33:52742) 2024-08-15T17:57:05.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9d96700 1 -- 172.21.15.33:0/1863274912 learned_addr learned my addr 172.21.15.33:0/1863274912 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:05.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a8d94700 1 --2- 172.21.15.33:0/1863274912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a40b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa797fff700 1 -- 172.21.15.33:0/1863274912 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150382854 0 0) 0x7fa7a40aba70 con 0x7fa7a4155010 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa797fff700 1 -- 172.21.15.33:0/1863274912 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003570 con 0x7fa7a4155010 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9595700 1 -- 172.21.15.33:0/1863274912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 msgr2=0x7fa7a40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9595700 1 --2- 172.21.15.33:0/1863274912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a40b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9595700 1 -- 172.21.15.33:0/1863274912 >> v1:172.21.15.33:6789/0 conn(0x7fa7a4155010 legacy=0x7fa7a4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9595700 1 -- 172.21.15.33:0/1863274912 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40ac310 con 0x7fa7a406e9d0 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7a9595700 1 --2- 172.21.15.33:0/1863274912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a406e9d0 0x7fa7a406eda0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa798009910 tx=0x7fa7980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f079169d7996ead4 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa797fff700 1 -- 172.21.15.33:0/1863274912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798011630 con 0x7fa7a406e9d0 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa797fff700 1 -- 172.21.15.33:0/1863274912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798011790 con 0x7fa7a406e9d0 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa797fff700 1 -- 172.21.15.33:0/1863274912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798011b30 con 0x7fa7a406e9d0 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- 172.21.15.33:0/1863274912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a406e9d0 msgr2=0x7fa7a406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1863274912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a406e9d0 0x7fa7a406eda0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa798009910 tx=0x7fa7980091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- 172.21.15.33:0/1863274912 shutdown_connections 2024-08-15T17:57:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1863274912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1863274912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a406e9d0 0x7fa7a406eda0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- 172.21.15.33:0/1863274912 >> 172.21.15.33:0/1863274912 conn(0x7fa7a40678d0 msgr2=0x7fa7a4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- 172.21.15.33:0/1863274912 shutdown_connections 2024-08-15T17:57:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.868+0000 7fa7aa597700 1 -- 172.21.15.33:0/1863274912 wait complete. 2024-08-15T17:57:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.872+0000 7fa7aa597700 1 Processor -- start 2024-08-15T17:57:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.872+0000 7fa7aa597700 1 -- start start 2024-08-15T17:57:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a406e9d0 0x7fa7a4149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 0x7fa7a4147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a414e310 con 0x7fa7a4155010 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a414ae50 con 0x7fa7a406e9d0 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a414a240 con 0x7fa7a40ab540 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 0x7fa7a4147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 0x7fa7a4147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52792/0 (socket says 172.21.15.33:52792) 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 -- 172.21.15.33:0/1998115281 learned_addr learned my addr 172.21.15.33:0/1998115281 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9595700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a406e9d0 0x7fa7a4149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a8d94700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 -- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 msgr2=0x7fa7a414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 -- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a406e9d0 msgr2=0x7fa7a4149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a406e9d0 0x7fa7a4149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 -- 172.21.15.33:0/1998115281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009420 con 0x7fa7a4155010 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7a9d96700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 0x7fa7a4147e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa79c001460 tx=0x7fa79c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00a870 con 0x7fa7a4155010 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00a9d0 con 0x7fa7a4155010 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a414a520 con 0x7fa7a4155010 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00ad50 con 0x7fa7a4155010 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a414aae0 con 0x7fa7a4155010 2024-08-15T17:57:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.876+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a406e5d0 con 0x7fa7a4155010 2024-08-15T17:57:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.880+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa79c007300 con 0x7fa7a4155010 2024-08-15T17:57:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.880+0000 7fa7957fa700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa788060860 0x7fa788062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.880+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fa79c07cff0 con 0x7fa7a4155010 2024-08-15T17:57:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.880+0000 7fa7a9595700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa788060860 0x7fa788062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.880+0000 7fa7a9595700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa788060860 0x7fa788062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa7980091e0 tx=0x7fa798017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:05.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:05.888+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa7a406e5d0 con 0x7fa7a4155010 2024-08-15T17:57:06.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.052+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a406e5d0 con 0x7fa7a4155010 2024-08-15T17:57:06.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.052+0000 7fa7957fa700 1 -- 172.21.15.33:0/1998115281 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15514 (secure 0 0 0) 0x7fa7a406e5d0 con 0x7fa7a4155010 2024-08-15T17:57:06.055 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:06.056 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":42,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:57:04.117559+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6837/2964556950":"2024-08-16T17:57:01.104153+0000","172.21.15.105:6835/2964556950":"2024-08-16T17:57:01.104153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa788060860 msgr2=0x7fa788062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa788060860 0x7fa788062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa7980091e0 tx=0x7fa798017000 comp rx=0 tx=0).stop 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 msgr2=0x7fa7a4147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 0x7fa7a4147e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa79c001460 tx=0x7fa79c001a40 comp rx=0 tx=0).stop 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 shutdown_connections 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa788060860 0x7fa788062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7a4155010 0x7fa7a4147e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a40ab540 0x7fa7a414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 --2- 172.21.15.33:0/1998115281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a406e9d0 0x7fa7a4149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 >> 172.21.15.33:0/1998115281 conn(0x7fa7a40678d0 msgr2=0x7fa7a4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 shutdown_connections 2024-08-15T17:57:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.056+0000 7fa7aa597700 1 -- 172.21.15.33:0/1998115281 wait complete. 2024-08-15T17:57:06.069 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000657299 and related pools 2024-08-15T17:57:06.069 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:57:06.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.168+0000 7fac67fff700 1 Processor -- start 2024-08-15T17:57:06.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.168+0000 7fac67fff700 1 -- start start 2024-08-15T17:57:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac67fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac68142b50 0x7fac680ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac67fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac680ca510 con 0x7fac68142780 2024-08-15T17:57:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac67fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac680cb290 con 0x7fac680cae50 2024-08-15T17:57:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac67fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac680c9900 con 0x7fac68142b50 2024-08-15T17:57:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac66ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fac68142780 0x7fac680ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52756/0 (socket says 172.21.15.33:52756) 2024-08-15T17:57:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac66ffd700 1 -- 172.21.15.33:0/1976960785 learned_addr learned my addr 172.21.15.33:0/1976960785 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac5e7fc700 1 --2- 172.21.15.33:0/1976960785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac68142b50 0x7fac680ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666636877 0 0) 0x7fac680ca510 con 0x7fac68142780 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac54003570 con 0x7fac68142780 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873393113 0 0) 0x7fac680cb290 con 0x7fac680cae50 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac680ca510 con 0x7fac680cae50 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac5e7fc700 1 -- 172.21.15.33:0/1976960785 >> v1:172.21.15.105:6789/0 conn(0x7fac680cae50 legacy=0x7fac6815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac5e7fc700 1 -- 172.21.15.33:0/1976960785 >> v1:172.21.15.33:6789/0 conn(0x7fac68142780 legacy=0x7fac680ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac5e7fc700 1 -- 172.21.15.33:0/1976960785 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac680c9be0 con 0x7fac68142b50 2024-08-15T17:57:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac5e7fc700 1 --2- 172.21.15.33:0/1976960785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac68142b50 0x7fac680ca910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac50009910 tx=0x7fac500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c6966ed464bfb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011630 con 0x7fac68142b50 2024-08-15T17:57:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50011790 con 0x7fac68142b50 2024-08-15T17:57:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.172+0000 7fac667fc700 1 -- 172.21.15.33:0/1976960785 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011b30 con 0x7fac68142b50 2024-08-15T17:57:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 -- 172.21.15.33:0/1976960785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac68142b50 msgr2=0x7fac680ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 --2- 172.21.15.33:0/1976960785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac68142b50 0x7fac680ca910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac50009910 tx=0x7fac500091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 -- 172.21.15.33:0/1976960785 shutdown_connections 2024-08-15T17:57:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 --2- 172.21.15.33:0/1976960785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac68142b50 0x7fac680ca910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 -- 172.21.15.33:0/1976960785 >> 172.21.15.33:0/1976960785 conn(0x7fac6806e070 msgr2=0x7fac680b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 -- 172.21.15.33:0/1976960785 shutdown_connections 2024-08-15T17:57:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 -- 172.21.15.33:0/1976960785 wait complete. 2024-08-15T17:57:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 Processor -- start 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 -- start start 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.176+0000 7fac67fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac680cae50 0x7fac68141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac68142780 0x7fac6812d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 0x7fac681583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6812e270 con 0x7fac68142b50 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6812e550 con 0x7fac68142780 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6812e830 con 0x7fac680cae50 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 0x7fac681583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 0x7fac681583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52800/0 (socket says 172.21.15.33:52800) 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 -- 172.21.15.33:0/871148586 learned_addr learned my addr 172.21.15.33:0/871148586 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac5e7fc700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac68142780 0x7fac6812d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac66ffd700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac680cae50 0x7fac68141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 -- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac680cae50 msgr2=0x7fac68141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac680cae50 0x7fac68141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 -- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac68142780 msgr2=0x7fac6812d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac68142780 0x7fac6812d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 -- 172.21.15.33:0/871148586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50009420 con 0x7fac68142b50 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac677fe700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 0x7fac681583d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c910 tx=0x7fac600027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60012630 con 0x7fac68142b50 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac600127b0 con 0x7fac68142b50 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6812eb10 con 0x7fac68142b50 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60012b70 con 0x7fac68142b50 2024-08-15T17:57:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6813eb30 con 0x7fac68142b50 2024-08-15T17:57:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.180+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6812f010 con 0x7fac68142b50 2024-08-15T17:57:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.184+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fac6001b400 con 0x7fac68142b50 2024-08-15T17:57:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.184+0000 7fac5f7fe700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fac48060860 0x7fac48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.184+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fac6007cfa0 con 0x7fac68142b50 2024-08-15T17:57:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.184+0000 7fac66ffd700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fac48060860 0x7fac48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.184+0000 7fac66ffd700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fac48060860 0x7fac48062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac58007fd0 tx=0x7fac58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.196+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fac6004d2d0 con 0x7fac68142b50 2024-08-15T17:57:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac680638f0 con 0x7fac68142b50 2024-08-15T17:57:06.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac5f7fe700 1 -- 172.21.15.33:0/871148586 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4615 (secure 0 0 0) 0x7fac60016090 con 0x7fac68142b50 2024-08-15T17:57:06.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:06.401 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3680521485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3680521485},{"type":"v1","addr":"172.21.15.105:6837","nonce":3680521485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:57:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fac48060860 msgr2=0x7fac48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fac48060860 0x7fac48062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac58007fd0 tx=0x7fac58009040 comp rx=0 tx=0).stop 2024-08-15T17:57:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 msgr2=0x7fac681583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 0x7fac681583d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c910 tx=0x7fac600027a0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 shutdown_connections 2024-08-15T17:57:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fac48060860 0x7fac48062d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac68142780 0x7fac6812d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac68142b50 0x7fac681583d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.400+0000 7fac67fff700 1 --2- 172.21.15.33:0/871148586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac680cae50 0x7fac68141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.404+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 >> 172.21.15.33:0/871148586 conn(0x7fac6806e070 msgr2=0x7fac6813f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:06.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.404+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 shutdown_connections 2024-08-15T17:57:06.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.404+0000 7fac67fff700 1 -- 172.21.15.33:0/871148586 wait complete. 2024-08-15T17:57:06.406 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-08-15T17:57:06.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:57:06.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 Processor -- start 2024-08-15T17:57:06.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 -- start start 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2ac015d540 0x7f2ac00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2ac006e830 0x7f2ac00a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac00a9260 0x7f2ac00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac00b0270 con 0x7f2ac006e830 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac00af660 con 0x7f2ac015d540 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2ac620c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00af940 con 0x7f2ac00a9260 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2abeffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2ac006e830 0x7f2ac00a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2abeffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2ac006e830 0x7f2ac00a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52814/0 (socket says 172.21.15.33:52814) 2024-08-15T17:57:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.520+0000 7f2abeffd700 1 -- 172.21.15.33:0/3550604217 learned_addr learned my addr 172.21.15.33:0/3550604217 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/3550604217 >> v2:172.21.15.105:3300/0 conn(0x7f2ac015d540 0x7f2ac00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abffff700 1 --2- 172.21.15.33:0/3550604217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac00a9260 0x7f2ac00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abeffd700 1 -- 172.21.15.33:0/3550604217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac00a9260 msgr2=0x7f2ac00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abeffd700 1 --2- 172.21.15.33:0/3550604217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac00a9260 0x7f2ac00b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abeffd700 1 -- 172.21.15.33:0/3550604217 >> v2:172.21.15.105:3300/0 conn(0x7f2ac015d540 msgr2=0x7f2ac00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abeffd700 1 --2- 172.21.15.33:0/3550604217 >> v2:172.21.15.105:3300/0 conn(0x7f2ac015d540 0x7f2ac00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abeffd700 1 -- 172.21.15.33:0/3550604217 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00afc20 con 0x7f2ac006e830 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/3550604217 >> v2:172.21.15.105:3300/0 conn(0x7f2ac015d540 0x7f2ac00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abeffd700 1 --2- 172.21.15.33:0/3550604217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac00a8d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2ac006b2d0 tx=0x7f2ab0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42111b27d9d85a48 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abe7fc700 1 -- 172.21.15.33:0/3550604217 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab000b860 con 0x7f2ac006e830 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abe7fc700 1 -- 172.21.15.33:0/3550604217 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab000b9c0 con 0x7f2ac006e830 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2abe7fc700 1 -- 172.21.15.33:0/3550604217 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab000bd60 con 0x7f2ac006e830 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 -- 172.21.15.33:0/3550604217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 msgr2=0x7f2ac00a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 --2- 172.21.15.33:0/3550604217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac00a8d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2ac006b2d0 tx=0x7f2ab0009250 comp rx=0 tx=0).stop 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 -- 172.21.15.33:0/3550604217 shutdown_connections 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 --2- 172.21.15.33:0/3550604217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac00a9260 0x7f2ac00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 --2- 172.21.15.33:0/3550604217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac00a8d20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 --2- 172.21.15.33:0/3550604217 >> v2:172.21.15.105:3300/0 conn(0x7f2ac015d540 0x7f2ac00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 -- 172.21.15.33:0/3550604217 >> 172.21.15.33:0/3550604217 conn(0x7f2ac0066e00 msgr2=0x7f2ac0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 -- 172.21.15.33:0/3550604217 shutdown_connections 2024-08-15T17:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.524+0000 7f2ac620c700 1 -- 172.21.15.33:0/3550604217 wait complete. 2024-08-15T17:57:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 Processor -- start 2024-08-15T17:57:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 -- start start 2024-08-15T17:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac0151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ac00a9260 0x7f2ac01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac015d540 0x7f2ac0151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00c8e90 con 0x7f2ac006e830 2024-08-15T17:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0152440 con 0x7f2ac00a9260 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00c8840 con 0x7f2ac015d540 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac0151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52826/0 (socket says 172.21.15.33:52826) 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 -- 172.21.15.33:0/84286243 learned_addr learned my addr 172.21.15.33:0/84286243 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abeffd700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ac00a9260 0x7f2ac01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abffff700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac015d540 0x7f2ac0151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 -- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac015d540 msgr2=0x7f2ac0151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac015d540 0x7f2ac0151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 -- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ac00a9260 msgr2=0x7f2ac01589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ac00a9260 0x7f2ac01589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 -- 172.21.15.33:0/84286243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00094f0 con 0x7f2ac006e830 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abeffd700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ac00a9260 0x7f2ac01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abffff700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac015d540 0x7f2ac0151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac0151380 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c850 tx=0x7f2aa8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8011600 con 0x7f2ac006e830 2024-08-15T17:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8011760 con 0x7f2ac006e830 2024-08-15T17:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac00c8b20 con 0x7f2ac006e830 2024-08-15T17:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.528+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8011b00 con 0x7f2ac006e830 2024-08-15T17:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.532+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac0152010 con 0x7f2ac006e830 2024-08-15T17:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.532+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac00c86a0 con 0x7f2ac006e830 2024-08-15T17:57:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.532+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2aa80073b0 con 0x7f2ac006e830 2024-08-15T17:57:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.532+0000 7f2ab77fe700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2aa0060860 0x7f2aa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.532+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2aa807cb70 con 0x7f2ac006e830 2024-08-15T17:57:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.532+0000 7f2abeffd700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2aa0060860 0x7f2aa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.536+0000 7f2abeffd700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2aa0060860 0x7f2aa0062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ac006b2d0 tx=0x7f2ab0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.540+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2ac00c86a0 con 0x7f2ac006e830 2024-08-15T17:57:06.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.740+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ac00c86a0 con 0x7f2ac006e830 2024-08-15T17:57:06.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.740+0000 7f2ab77fe700 1 -- 172.21.15.33:0/84286243 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f2ac00c86a0 con 0x7f2ac006e830 2024-08-15T17:57:06.742 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:06.742 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3680521485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3680521485},{"type":"v1","addr":"172.21.15.105:6837","nonce":3680521485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-15T17:54:54.378397+0000","modified":"2024-08-15T17:54:55.880615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4999":{"gid":4999,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6836/2560726379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2560726379},{"type":"v1","addr":"172.21.15.105:6836","nonce":2560726379}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000657299","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-15T17:57:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2aa0060860 msgr2=0x7f2aa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2aa0060860 0x7f2aa0062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ac006b2d0 tx=0x7f2ab0017000 comp rx=0 tx=0).stop 2024-08-15T17:57:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 msgr2=0x7f2ac0151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac0151380 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c850 tx=0x7f2aa8008040 comp rx=0 tx=0).stop 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 shutdown_connections 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2aa0060860 0x7f2aa0062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ac00a9260 0x7f2ac01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ac015d540 0x7f2ac0151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 --2- 172.21.15.33:0/84286243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac006e830 0x7f2ac0151380 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 >> 172.21.15.33:0/84286243 conn(0x7f2ac0066e00 msgr2=0x7f2ac01623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 shutdown_connections 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.744+0000 7f2ac620c700 1 -- 172.21.15.33:0/84286243 wait complete. 2024-08-15T17:57:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-08-15T17:57:06.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:57:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.860+0000 7ff572fcf700 1 Processor -- start 2024-08-15T17:57:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.860+0000 7ff572fcf700 1 -- start start 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff56c15c970 0x7ff56c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff56c069960 0x7ff56c068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0c77c0 con 0x7ff56c15c5a0 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0cb510 con 0x7ff56c069960 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0c6c80 con 0x7ff56c15c970 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff56c069960 0x7ff56c068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff56c069960 0x7ff56c068be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52840/0 (socket says 172.21.15.33:52840) 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff56bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff56c15c970 0x7ff56c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 -- 172.21.15.33:0/2159238341 learned_addr learned my addr 172.21.15.33:0/2159238341 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 -- 172.21.15.33:0/2159238341 >> v2:172.21.15.105:3300/0 conn(0x7ff56c15c970 msgr2=0x7ff56c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 --2- 172.21.15.33:0/2159238341 >> v2:172.21.15.105:3300/0 conn(0x7ff56c15c970 0x7ff56c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 -- 172.21.15.33:0/2159238341 >> v1:172.21.15.105:6789/0 conn(0x7ff56c15c5a0 legacy=0x7ff56c0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 -- 172.21.15.33:0/2159238341 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0c6e90 con 0x7ff56c069960 2024-08-15T17:57:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff56bfff700 1 --2- 172.21.15.33:0/2159238341 >> v2:172.21.15.105:3300/0 conn(0x7ff56c15c970 0x7ff56c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff57156c700 1 --2- 172.21.15.33:0/2159238341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c069960 0x7ff56c068be0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0b28a0 tx=0x7ff55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f85d693f9abfb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff56b7fe700 1 -- 172.21.15.33:0/2159238341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c009e70 con 0x7ff56c069960 2024-08-15T17:57:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff56b7fe700 1 -- 172.21.15.33:0/2159238341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00b860 con 0x7ff56c069960 2024-08-15T17:57:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff56b7fe700 1 -- 172.21.15.33:0/2159238341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00bc00 con 0x7ff56c069960 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- 172.21.15.33:0/2159238341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c069960 msgr2=0x7ff56c068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 --2- 172.21.15.33:0/2159238341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c069960 0x7ff56c068be0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0b28a0 tx=0x7ff55c009250 comp rx=0 tx=0).stop 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- 172.21.15.33:0/2159238341 shutdown_connections 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 --2- 172.21.15.33:0/2159238341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c069960 0x7ff56c068be0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 --2- 172.21.15.33:0/2159238341 >> v2:172.21.15.105:3300/0 conn(0x7ff56c15c970 0x7ff56c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- 172.21.15.33:0/2159238341 >> 172.21.15.33:0/2159238341 conn(0x7ff56c0c9c20 msgr2=0x7ff56c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- 172.21.15.33:0/2159238341 shutdown_connections 2024-08-15T17:57:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.864+0000 7ff572fcf700 1 -- 172.21.15.33:0/2159238341 wait complete. 2024-08-15T17:57:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 Processor -- start 2024-08-15T17:57:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 -- start start 2024-08-15T17:57:06.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff56c069960 0x7ff56c145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 0x7ff56c0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff56c15c970 0x7ff56c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b1660 con 0x7ff56c15c5a0 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b0a50 con 0x7ff56c15c970 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff572fcf700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b0d30 con 0x7ff56c069960 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 0x7ff56c0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 0x7ff56c0c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52848/0 (socket says 172.21.15.33:52848) 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 -- 172.21.15.33:0/1650769635 learned_addr learned my addr 172.21.15.33:0/1650769635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff570d6b700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff56c069960 0x7ff56c145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff57156c700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff56c15c970 0x7ff56c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 -- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff56c069960 msgr2=0x7ff56c145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff56c069960 0x7ff56c145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 -- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff56c15c970 msgr2=0x7ff56c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff56c15c970 0x7ff56c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 -- 172.21.15.33:0/1650769635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009420 con 0x7ff56c15c5a0 2024-08-15T17:57:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff570d6b700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff56c069960 0x7ff56c145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.868+0000 7ff56bfff700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 0x7ff56c0c36f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff56000ec80 tx=0x7ff5600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000c8f0 con 0x7ff56c15c5a0 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000ca50 con 0x7ff56c15c5a0 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000cdd0 con 0x7ff56c15c5a0 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c0094f0 con 0x7ff56c15c5a0 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c0b12f0 con 0x7ff56c15c5a0 2024-08-15T17:57:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c0645c0 con 0x7ff56c15c5a0 2024-08-15T17:57:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff560013680 con 0x7ff56c15c5a0 2024-08-15T17:57:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff568ff9700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff558060860 0x7ff558062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff56007d330 con 0x7ff56c15c5a0 2024-08-15T17:57:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.872+0000 7ff570d6b700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff558060860 0x7ff558062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:06.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.876+0000 7ff570d6b700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff558060860 0x7ff558062d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff564007fd0 tx=0x7ff564009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:06.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:06.880+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff56004d660 con 0x7ff56c15c5a0 2024-08-15T17:57:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.044+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff56c0c19d0 con 0x7ff56c15c5a0 2024-08-15T17:57:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.044+0000 7ff568ff9700 1 -- 172.21.15.33:0/1650769635 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15514 (secure 0 0 0) 0x7ff560050c80 con 0x7ff56c15c5a0 2024-08-15T17:57:07.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:07.047 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":42,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:57:04.117559+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000657299.meta","create_time":"2024-08-15T17:54:52.374842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000657299"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000657299.data","create_time":"2024-08-15T17:54:53.390917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000657299"}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6837/2964556950":"2024-08-16T17:57:01.104153+0000","172.21.15.105:6835/2964556950":"2024-08-16T17:57:01.104153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:57:07.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff558060860 msgr2=0x7ff558062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff558060860 0x7ff558062d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff564007fd0 tx=0x7ff564009040 comp rx=0 tx=0).stop 2024-08-15T17:57:07.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 msgr2=0x7ff56c0c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 0x7ff56c0c36f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff56000ec80 tx=0x7ff5600091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 shutdown_connections 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff558060860 0x7ff558062d10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff56c15c970 0x7ff56c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff56c15c5a0 0x7ff56c0c36f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 --2- 172.21.15.33:0/1650769635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff56c069960 0x7ff56c145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 >> 172.21.15.33:0/1650769635 conn(0x7ff56c0c9c20 msgr2=0x7ff56c0ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 shutdown_connections 2024-08-15T17:57:07.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.048+0000 7ff572fcf700 1 -- 172.21.15.33:0/1650769635 wait complete. 2024-08-15T17:57:07.062 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000657299 2024-08-15T17:57:07.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 Processor -- start 2024-08-15T17:57:07.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 -- start start 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a9c0afac0 0x7f5a9c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5a9c0b1280 0x7f5a9c162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c069cd0 con 0x7f5a9c142a20 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0b1700 con 0x7f5a9c0afac0 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9bfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c068e60 con 0x7f5a9c0b1280 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a9c0afac0 0x7f5a9c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a9c0afac0 0x7f5a9c0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52852/0 (socket says 172.21.15.33:52852) 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 -- 172.21.15.33:0/2355316638 learned_addr learned my addr 172.21.15.33:0/2355316638 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9affd700 1 --1- 172.21.15.33:0/2355316638 >> v1:172.21.15.33:6789/0 conn(0x7f5a9c142a20 0x7f5a9c068750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52762/0 (socket says 172.21.15.33:52762) 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9b7fe700 1 --2- 172.21.15.33:0/2355316638 >> v2:172.21.15.105:3300/0 conn(0x7f5a9c0b1280 0x7f5a9c162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 -- 172.21.15.33:0/2355316638 >> v2:172.21.15.105:3300/0 conn(0x7f5a9c0b1280 msgr2=0x7f5a9c162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 --2- 172.21.15.33:0/2355316638 >> v2:172.21.15.105:3300/0 conn(0x7f5a9c0b1280 0x7f5a9c162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 -- 172.21.15.33:0/2355316638 >> v1:172.21.15.33:6789/0 conn(0x7f5a9c142a20 legacy=0x7f5a9c068750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 -- 172.21.15.33:0/2355316638 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0690c0 con 0x7f5a9c0afac0 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.172+0000 7f5a9a7fc700 1 --2- 172.21.15.33:0/2355316638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0afac0 0x7f5a9c0b0d40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0b0760 tx=0x7f5a8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9db26737e35715 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a99ffb700 1 -- 172.21.15.33:0/2355316638 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00b860 con 0x7f5a9c0afac0 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a99ffb700 1 -- 172.21.15.33:0/2355316638 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c00b9c0 con 0x7f5a9c0afac0 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a99ffb700 1 -- 172.21.15.33:0/2355316638 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00bd60 con 0x7f5a9c0afac0 2024-08-15T17:57:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- 172.21.15.33:0/2355316638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0afac0 msgr2=0x7f5a9c0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/2355316638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0afac0 0x7f5a9c0b0d40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0b0760 tx=0x7f5a8c009250 comp rx=0 tx=0).stop 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- 172.21.15.33:0/2355316638 shutdown_connections 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/2355316638 >> v2:172.21.15.105:3300/0 conn(0x7f5a9c0b1280 0x7f5a9c162cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/2355316638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0afac0 0x7f5a9c0b0d40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- 172.21.15.33:0/2355316638 >> 172.21.15.33:0/2355316638 conn(0x7f5a9c0cdeb0 msgr2=0x7f5a9c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- 172.21.15.33:0/2355316638 shutdown_connections 2024-08-15T17:57:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- 172.21.15.33:0/2355316638 wait complete. 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 Processor -- start 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- start start 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c0afac0 0x7f5a9c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c0b1280 0x7f5a9c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 0x7f5a9c0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0c7420 con 0x7f5a9c142a20 2024-08-15T17:57:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15d6c0 con 0x7f5a9c0b1280 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0c8690 con 0x7f5a9c0afac0 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 0x7f5a9c0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 0x7f5a9c0c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52862/0 (socket says 172.21.15.33:52862) 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.176+0000 7f5a9b7fe700 1 -- 172.21.15.33:0/3431117569 learned_addr learned my addr 172.21.15.33:0/3431117569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9a7fc700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c0b1280 0x7f5a9c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9affd700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c0afac0 0x7f5a9c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9b7fe700 1 -- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c0afac0 msgr2=0x7f5a9c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9b7fe700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c0afac0 0x7f5a9c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9b7fe700 1 -- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c0b1280 msgr2=0x7f5a9c0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9b7fe700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c0b1280 0x7f5a9c0c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9b7fe700 1 -- 172.21.15.33:0/3431117569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0094f0 con 0x7f5a9c142a20 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9b7fe700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 0x7f5a9c0c7ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009fa0 tx=0x7f5a94009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400ebc0 con 0x7f5a9c142a20 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400ed20 con 0x7f5a9c142a20 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c0ca630 con 0x7f5a9c142a20 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94014670 con 0x7f5a9c142a20 2024-08-15T17:57:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c15db50 con 0x7f5a9c142a20 2024-08-15T17:57:07.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.180+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c15d850 con 0x7f5a9c142a20 2024-08-15T17:57:07.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.184+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5a940149e0 con 0x7f5a9c142a20 2024-08-15T17:57:07.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.184+0000 7f5a82ffd700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5a88060860 0x7f5a88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.184+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5a9407d2a0 con 0x7f5a9c142a20 2024-08-15T17:57:07.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.184+0000 7f5a9affd700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5a88060860 0x7f5a88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.184+0000 7f5a9affd700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5a88060860 0x7f5a88062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a90004fd0 tx=0x7f5a90007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.188+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5a9404d670 con 0x7f5a9c142a20 2024-08-15T17:57:07.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.392+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000657299"} v 0) v1 -- 0x7f5a9c0638f0 con 0x7f5a9c142a20 2024-08-15T17:57:07.392 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-08-15T17:57:07.392+0000 7f11dc36e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-15T17:57:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.400+0000 7f5a82ffd700 1 -- 172.21.15.33:0/3431117569 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000657299"}]=0 volume_0000000000657299 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 195+0+0 (secure 0 0 0) 0x7f5a94050c90 con 0x7f5a9c142a20 2024-08-15T17:57:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5a88060860 msgr2=0x7f5a88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5a88060860 0x7f5a88062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a90004fd0 tx=0x7f5a90007eb0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 msgr2=0x7f5a9c0c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 0x7f5a9c0c7ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009fa0 tx=0x7f5a94009900 comp rx=0 tx=0).stop 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 shutdown_connections 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5a88060860 0x7f5a88062d10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a9c0b1280 0x7f5a9c0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c142a20 0x7f5a9c0c7ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 --2- 172.21.15.33:0/3431117569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9c0afac0 0x7f5a9c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 >> 172.21.15.33:0/3431117569 conn(0x7f5a9c0cdeb0 msgr2=0x7f5a9c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 shutdown_connections 2024-08-15T17:57:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.404+0000 7f5a9bfff700 1 -- 172.21.15.33:0/3431117569 wait complete. 2024-08-15T17:57:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:volume_0000000000657299 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-15T17:57:07.406 INFO:tasks.ceph.mds.b.smithi105.stderr: -3080> 2024-08-15T17:54:59.684+0000 7f1ebc38d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-15T17:57:07.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000657299 --yes-i-really-mean-it 2024-08-15T17:57:07.433 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-08-15T17:57:07.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.528+0000 7f81a359e700 1 Processor -- start 2024-08-15T17:57:07.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.528+0000 7f81a359e700 1 -- start start 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f81a413fa50 0x7f81a40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81a40ad6c0 0x7f81a406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40b0810 con 0x7f81a413f680 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40afc70 con 0x7f81a40ad6c0 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40af060 con 0x7f81a413fa50 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a2d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81a40ad6c0 0x7f81a406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f81a413f680 0x7f81a40b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52776/0 (socket says 172.21.15.33:52776) 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a259c700 1 -- 172.21.15.33:0/3689013914 learned_addr learned my addr 172.21.15.33:0/3689013914 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:07.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a1d9b700 1 --2- 172.21.15.33:0/3689013914 >> v2:172.21.15.105:3300/0 conn(0x7f81a413fa50 0x7f81a40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a159a700 1 -- 172.21.15.33:0/3689013914 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007569775 0 0) 0x7f81a40b0810 con 0x7f81a413f680 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3689013914 >> v2:172.21.15.105:3300/0 conn(0x7f81a413fa50 msgr2=0x7f81a40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a2d9d700 1 --2- 172.21.15.33:0/3689013914 >> v2:172.21.15.105:3300/0 conn(0x7f81a413fa50 0x7f81a40aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3689013914 >> v1:172.21.15.33:6789/0 conn(0x7f81a413f680 legacy=0x7f81a40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3689013914 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40af340 con 0x7f81a40ad6c0 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a2d9d700 1 --2- 172.21.15.33:0/3689013914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a40ad6c0 0x7f81a406e010 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f81a40ae820 tx=0x7f819c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b1d9487d9b4c86 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a159a700 1 -- 172.21.15.33:0/3689013914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011630 con 0x7f81a40ad6c0 2024-08-15T17:57:07.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a159a700 1 -- 172.21.15.33:0/3689013914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c011790 con 0x7f81a40ad6c0 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a159a700 1 -- 172.21.15.33:0/3689013914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011b30 con 0x7f81a40ad6c0 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- 172.21.15.33:0/3689013914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a40ad6c0 msgr2=0x7f81a406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 --2- 172.21.15.33:0/3689013914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a40ad6c0 0x7f81a406e010 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f81a40ae820 tx=0x7f819c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- 172.21.15.33:0/3689013914 shutdown_connections 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 --2- 172.21.15.33:0/3689013914 >> v2:172.21.15.105:3300/0 conn(0x7f81a413fa50 0x7f81a40aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 --2- 172.21.15.33:0/3689013914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a40ad6c0 0x7f81a406e010 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- 172.21.15.33:0/3689013914 >> 172.21.15.33:0/3689013914 conn(0x7f81a40678a0 msgr2=0x7f81a4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- 172.21.15.33:0/3689013914 shutdown_connections 2024-08-15T17:57:07.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.532+0000 7f81a359e700 1 -- 172.21.15.33:0/3689013914 wait complete. 2024-08-15T17:57:07.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 Processor -- start 2024-08-15T17:57:07.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 -- start start 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81a40ad6c0 0x7f81a4153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81a413f680 0x7f81a4126ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 0x7f81a4134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4126b60 con 0x7f81a413fa50 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4153ba0 con 0x7f81a413f680 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4125c70 con 0x7f81a40ad6c0 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 0x7f81a4134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 0x7f81a4134980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52876/0 (socket says 172.21.15.33:52876) 2024-08-15T17:57:07.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a1d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81a413f680 0x7f81a4126ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a259c700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81a40ad6c0 0x7f81a4153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3872159198 learned_addr learned my addr 172.21.15.33:0/3872159198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81a40ad6c0 msgr2=0x7f81a4153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81a40ad6c0 0x7f81a4153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81a413f680 msgr2=0x7f81a4126ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81a413f680 0x7f81a4126ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 -- 172.21.15.33:0/3872159198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009420 con 0x7f81a413fa50 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a2d9d700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 0x7f81a4134980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f819c009f50 tx=0x7f819c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011b10 con 0x7f81a413fa50 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0233f0 con 0x7f81a413fa50 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4125f50 con 0x7f81a413fa50 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c023770 con 0x7f81a413fa50 2024-08-15T17:57:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.536+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4126510 con 0x7f81a413fa50 2024-08-15T17:57:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.540+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a4126cd0 con 0x7f81a413fa50 2024-08-15T17:57:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.540+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f819c023ae0 con 0x7f81a413fa50 2024-08-15T17:57:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.540+0000 7f819a7fc700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8188060860 0x7f8188062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.540+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f819c07e160 con 0x7f81a413fa50 2024-08-15T17:57:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.540+0000 7f81a259c700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8188060860 0x7f8188062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.540+0000 7f81a259c700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8188060860 0x7f8188062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f81a40639d0 tx=0x7f8194007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:07.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.548+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f819c04e4d0 con 0x7f81a413fa50 2024-08-15T17:57:07.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:07.748+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000657299", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f81a4064330 con 0x7f81a413fa50 2024-08-15T17:57:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.404+0000 7f819a7fc700 1 -- 172.21.15.33:0/3872159198 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000657299", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f819c051af0 con 0x7f81a413fa50 2024-08-15T17:57:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8188060860 msgr2=0x7f8188062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8188060860 0x7f8188062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f81a40639d0 tx=0x7f8194007d30 comp rx=0 tx=0).stop 2024-08-15T17:57:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 msgr2=0x7f81a4134980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 0x7f81a4134980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f819c009f50 tx=0x7f819c017000 comp rx=0 tx=0).stop 2024-08-15T17:57:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 shutdown_connections 2024-08-15T17:57:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8188060860 0x7f8188062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81a413f680 0x7f81a4126ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a413fa50 0x7f81a4134980 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 --2- 172.21.15.33:0/3872159198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81a40ad6c0 0x7f81a4153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 >> 172.21.15.33:0/3872159198 conn(0x7f81a40678a0 msgr2=0x7f81a413dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 shutdown_connections 2024-08-15T17:57:08.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.408+0000 7f81a359e700 1 -- 172.21.15.33:0/3872159198 wait complete. 2024-08-15T17:57:08.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000657299.meta cephfs.volume_0000000000657299.meta --yes-i-really-really-mean-it 2024-08-15T17:57:08.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e3542700 1 Processor -- start 2024-08-15T17:57:08.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e3542700 1 -- start start 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e3542700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb3dc0cf720 0x7fb3dc0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e3542700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0cfb20 con 0x7fb3dc159500 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e3542700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0d09c0 con 0x7fb3dc0cf2e0 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e3542700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc15aab0 con 0x7fb3dc0cf720 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e1adf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb3dc0cf720 0x7fb3dc0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e12de700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb3dc159500 0x7fb3dc0cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51512/0 (socket says 172.21.15.33:51512) 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e1adf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb3dc0cf720 0x7fb3dc0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59580/0 (socket says 172.21.15.33:59580) 2024-08-15T17:57:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e12de700 1 -- 172.21.15.33:0/2732994315 learned_addr learned my addr 172.21.15.33:0/2732994315 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e1adf700 1 -- 172.21.15.33:0/2732994315 >> v1:172.21.15.105:6789/0 conn(0x7fb3dc0cf2e0 legacy=0x7fb3dc0ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e1adf700 1 -- 172.21.15.33:0/2732994315 >> v1:172.21.15.33:6789/0 conn(0x7fb3dc159500 legacy=0x7fb3dc0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e1adf700 1 -- 172.21.15.33:0/2732994315 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0d0c10 con 0x7fb3dc0cf720 2024-08-15T17:57:08.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3e1adf700 1 --2- 172.21.15.33:0/2732994315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0caf60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009e60 tx=0x7fb3d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d257a2afa59a091 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:08.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3d3fff700 1 -- 172.21.15.33:0/2732994315 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400e070 con 0x7fb3dc0cf720 2024-08-15T17:57:08.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3d3fff700 1 -- 172.21.15.33:0/2732994315 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bc30 con 0x7fb3dc0cf720 2024-08-15T17:57:08.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.552+0000 7fb3d3fff700 1 -- 172.21.15.33:0/2732994315 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4012430 con 0x7fb3dc0cf720 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 -- 172.21.15.33:0/2732994315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 msgr2=0x7fb3dc0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 --2- 172.21.15.33:0/2732994315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0caf60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009e60 tx=0x7fb3d4009780 comp rx=0 tx=0).stop 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 -- 172.21.15.33:0/2732994315 shutdown_connections 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 --2- 172.21.15.33:0/2732994315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0caf60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 -- 172.21.15.33:0/2732994315 >> 172.21.15.33:0/2732994315 conn(0x7fb3dc067590 msgr2=0x7fb3dc0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 -- 172.21.15.33:0/2732994315 shutdown_connections 2024-08-15T17:57:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 -- 172.21.15.33:0/2732994315 wait complete. 2024-08-15T17:57:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 Processor -- start 2024-08-15T17:57:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.556+0000 7fb3e3542700 1 -- start start 2024-08-15T17:57:08.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3dc0cf2e0 0x7fb3dc09c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:08.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:08.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3dc159500 0x7fb3dc09ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc09a2b0 con 0x7fb3dc0cf720 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc09a870 con 0x7fb3dc159500 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c6190 con 0x7fb3dc0cf2e0 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e1adf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3dc159500 0x7fb3dc09ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e12de700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3dc0cf2e0 0x7fb3dc09c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59584/0 (socket says 172.21.15.33:59584) 2024-08-15T17:57:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 -- 172.21.15.33:0/830466092 learned_addr learned my addr 172.21.15.33:0/830466092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 -- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3dc0cf2e0 msgr2=0x7fb3dc09c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3dc0cf2e0 0x7fb3dc09c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 -- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3dc159500 msgr2=0x7fb3dc09ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3dc159500 0x7fb3dc09ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 -- 172.21.15.33:0/830466092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009a20 con 0x7fb3dc0cf720 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e1adf700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3dc159500 0x7fb3dc09ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e0add700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0c56a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c790 tx=0x7fb3cc007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011590 con 0x7fb3dc0cf720 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc011710 con 0x7fb3dc0cf720 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc0c6470 con 0x7fb3dc0cf720 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011ad0 con 0x7fb3dc0cf720 2024-08-15T17:57:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.560+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc1589b0 con 0x7fb3dc0cf720 2024-08-15T17:57:08.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.564+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0638f0 con 0x7fb3dc0cf720 2024-08-15T17:57:08.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.564+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb3cc01b3b0 con 0x7fb3dc0cf720 2024-08-15T17:57:08.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.564+0000 7fb3d17fa700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb3c0060860 0x7fb3c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:08.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.564+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fb3cc07c000 con 0x7fb3dc0cf720 2024-08-15T17:57:08.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.564+0000 7fb3e12de700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb3c0060860 0x7fb3c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:08.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.568+0000 7fb3e12de700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb3c0060860 0x7fb3c0062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0ce410 tx=0x7fb3d8000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.572+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb3cc04c370 con 0x7fb3dc0cf720 2024-08-15T17:57:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:08.740+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000657299.meta", "pool2": "cephfs.volume_0000000000657299.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3dc068f30 con 0x7fb3dc0cf720 2024-08-15T17:57:09.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.404+0000 7fb3d17fa700 1 -- 172.21.15.33:0/830466092 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000657299.meta", "pool2": "cephfs.volume_0000000000657299.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000657299.meta' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7fb3cc04f990 con 0x7fb3dc0cf720 2024-08-15T17:57:09.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb3c0060860 msgr2=0x7fb3c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb3c0060860 0x7fb3c0062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0ce410 tx=0x7fb3d8000bc0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 msgr2=0x7fb3dc0c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0c56a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c790 tx=0x7fb3cc007f40 comp rx=0 tx=0).stop 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 shutdown_connections 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb3c0060860 0x7fb3c0062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3dc159500 0x7fb3dc09ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3dc0cf720 0x7fb3dc0c56a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 --2- 172.21.15.33:0/830466092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3dc0cf2e0 0x7fb3dc09c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 >> 172.21.15.33:0/830466092 conn(0x7fb3dc067590 msgr2=0x7fb3dc069450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 shutdown_connections 2024-08-15T17:57:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.416+0000 7fb3e3542700 1 -- 172.21.15.33:0/830466092 wait complete. 2024-08-15T17:57:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000657299.meta' removed 2024-08-15T17:57:09.430 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000657299.data cephfs.volume_0000000000657299.data --yes-i-really-really-mean-it 2024-08-15T17:57:09.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95ffff700 1 Processor -- start 2024-08-15T17:57:09.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95ffff700 1 -- start start 2024-08-15T17:57:09.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95ffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe960156f40 0x7fe960160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95ffff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9600cb7d0 con 0x7fe9600ae250 2024-08-15T17:57:09.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95ffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9600af590 con 0x7fe9600ae620 2024-08-15T17:57:09.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95ffff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9600ccc70 con 0x7fe960156f40 2024-08-15T17:57:09.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe9600ae250 0x7fe9601599d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51520/0 (socket says 172.21.15.33:51520) 2024-08-15T17:57:09.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95effd700 1 -- 172.21.15.33:0/2702717477 learned_addr learned my addr 172.21.15.33:0/2702717477 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95f7fe700 1 --2- 172.21.15.33:0/2702717477 >> v2:172.21.15.105:3300/0 conn(0x7fe960156f40 0x7fe960160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273053246 0 0) 0x7fe9600cb7d0 con 0x7fe9600ae250 2024-08-15T17:57:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe94c003570 con 0x7fe9600ae250 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067770355 0 0) 0x7fe94c003570 con 0x7fe9600ae250 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 >> v2:172.21.15.105:3300/0 conn(0x7fe960156f40 msgr2=0x7fe960160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 --2- 172.21.15.33:0/2702717477 >> v2:172.21.15.105:3300/0 conn(0x7fe960156f40 0x7fe960160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 >> v1:172.21.15.105:6789/0 conn(0x7fe9600ae620 legacy=0x7fe960155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96015a500 con 0x7fe9600ae250 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fe9580017f0 con 0x7fe9600ae250 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 >> v1:172.21.15.33:6789/0 conn(0x7fe9600ae250 legacy=0x7fe9601599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe94c003a60 0x7fe94c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe94c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe94c0051c0 0x7fe94c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600ccc70 con 0x7fe94c003a60 2024-08-15T17:57:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c00c0d0 con 0x7fe94c004810 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c00c290 con 0x7fe94c0051c0 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.540+0000 7fe95effd700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe94c003a60 0x7fe94c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe94c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95f7fe700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe94c0051c0 0x7fe94c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 -- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe94c0051c0 msgr2=0x7fe94c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe94c0051c0 0x7fe94c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 -- 172.21.15.33:0/2702717477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe94c003a60 msgr2=0x7fe94c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe94c003a60 0x7fe94c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 -- 172.21.15.33:0/2702717477 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c003570 con 0x7fe94c004810 2024-08-15T17:57:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95effd700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe94c003a60 0x7fe94c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95f7fe700 1 -- 172.21.15.33:0/2702717477 reap_dead start 2024-08-15T17:57:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe94c004c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe948001360 tx=0x7fe948007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2aecd1879a12bd server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480104a0 con 0x7fe94c004810 2024-08-15T17:57:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948010620 con 0x7fe94c004810 2024-08-15T17:57:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95dffb700 1 -- 172.21.15.33:0/2702717477 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480107d0 con 0x7fe94c004810 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 -- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 msgr2=0x7fe94c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe94c004c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe948001360 tx=0x7fe948007d30 comp rx=0 tx=0).stop 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 -- 172.21.15.33:0/2702717477 shutdown_connections 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 --2- 172.21.15.33:0/2702717477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe94c004c80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 -- 172.21.15.33:0/2702717477 >> 172.21.15.33:0/2702717477 conn(0x7fe9600a9d30 msgr2=0x7fe9600ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 -- 172.21.15.33:0/2702717477 shutdown_connections 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.544+0000 7fe95ffff700 1 -- 172.21.15.33:0/2702717477 wait complete. 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 Processor -- start 2024-08-15T17:57:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 -- start start 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe96014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 0x7fe9601513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960157770 0x7fe960157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96014aaa0 con 0x7fe96014c2f0 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe960158120 con 0x7fe94c004810 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe960150550 con 0x7fe960157770 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 0x7fe9601513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 0x7fe9601513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59606/0 (socket says 172.21.15.33:59606) 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 -- 172.21.15.33:0/3696882481 learned_addr learned my addr 172.21.15.33:0/3696882481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95effd700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe96014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95f7fe700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960157770 0x7fe960157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 -- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960157770 msgr2=0x7fe960157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960157770 0x7fe960157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 -- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 msgr2=0x7fe96014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe96014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 -- 172.21.15.33:0/3696882481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960151930 con 0x7fe96014c2f0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95e7fc700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 0x7fe9601513f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe948011b50 tx=0x7fe948017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948021070 con 0x7fe96014c2f0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9480104a0 con 0x7fe96014c2f0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96014f940 con 0x7fe96014c2f0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948001200 con 0x7fe96014c2f0 2024-08-15T17:57:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.548+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96014ff00 con 0x7fe96014c2f0 2024-08-15T17:57:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.552+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9600644b0 con 0x7fe96014c2f0 2024-08-15T17:57:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.552+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe948006d40 con 0x7fe96014c2f0 2024-08-15T17:57:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.552+0000 7fe956ffd700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe940060890 0x7fe940062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.552+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fe948015020 con 0x7fe96014c2f0 2024-08-15T17:57:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.552+0000 7fe95effd700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe940060890 0x7fe940062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.552+0000 7fe95effd700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe940060890 0x7fe940062d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe958002060 tx=0x7fe958006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.560+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe94804fee0 con 0x7fe96014c2f0 2024-08-15T17:57:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:09.724+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000657299.data", "pool2": "cephfs.volume_0000000000657299.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe960150690 con 0x7fe96014c2f0 2024-08-15T17:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.416+0000 7fe956ffd700 1 -- 172.21.15.33:0/3696882481 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000657299.data", "pool2": "cephfs.volume_0000000000657299.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000657299.data' removed v45) v1 ==== 241+0+0 (secure 0 0 0) 0x7fe948010790 con 0x7fe96014c2f0 2024-08-15T17:57:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe940060890 msgr2=0x7fe940062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe940060890 0x7fe940062d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe958002060 tx=0x7fe958006040 comp rx=0 tx=0).stop 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 msgr2=0x7fe9601513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 0x7fe9601513f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe948011b50 tx=0x7fe948017000 comp rx=0 tx=0).stop 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 shutdown_connections 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe940060890 0x7fe940062d40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960157770 0x7fe960157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96014c2f0 0x7fe9601513f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 --2- 172.21.15.33:0/3696882481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe94c004810 0x7fe96014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 >> 172.21.15.33:0/3696882481 conn(0x7fe9600a9d30 msgr2=0x7fe9600b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 shutdown_connections 2024-08-15T17:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.424+0000 7fe95ffff700 1 -- 172.21.15.33:0/3696882481 wait complete. 2024-08-15T17:57:10.426 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000657299.data' removed 2024-08-15T17:57:10.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-15T17:57:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.556+0000 7fd1e1308700 1 Processor -- start 2024-08-15T17:57:10.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.556+0000 7fd1e1308700 1 -- start start 2024-08-15T17:57:10.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e1308700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd1dc1532e0 0x7fd1dc0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e1308700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0ace30 con 0x7fd1dc06eea0 2024-08-15T17:57:10.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e1308700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc156dd0 con 0x7fd1dc06ead0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e1308700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc156450 con 0x7fd1dc1532e0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd1dc06eea0 0x7fd1dc152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51530/0 (socket says 172.21.15.33:51530) 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 -- 172.21.15.33:0/673215988 learned_addr learned my addr 172.21.15.33:0/673215988 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e0b07700 1 --2- 172.21.15.33:0/673215988 >> v2:172.21.15.105:3300/0 conn(0x7fd1dc1532e0 0x7fd1dc0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849580030 0 0) 0x7fd1dc0ace30 con 0x7fd1dc06eea0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003570 con 0x7fd1dc06eea0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448894600 0 0) 0x7fd1c8003570 con 0x7fd1dc06eea0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 >> v2:172.21.15.105:3300/0 conn(0x7fd1dc1532e0 msgr2=0x7fd1dc0b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 --2- 172.21.15.33:0/673215988 >> v2:172.21.15.105:3300/0 conn(0x7fd1dc1532e0 0x7fd1dc0b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 >> v1:172.21.15.105:6789/0 conn(0x7fd1dc06ead0 legacy=0x7fd1dc155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc156730 con 0x7fd1dc06eea0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7fd1cc001470 con 0x7fd1dc06eea0 2024-08-15T17:57:10.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 >> v1:172.21.15.33:6789/0 conn(0x7fd1dc06eea0 legacy=0x7fd1dc152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c8003a60 0x7fd1c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc156450 con 0x7fd1c8003a60 2024-08-15T17:57:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c160 con 0x7fd1c8004810 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c320 con 0x7fd1c80051c0 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1dbfff700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c8003a60 0x7fd1c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e0b07700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 -- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1c80051c0 msgr2=0x7fd1c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1c80051c0 0x7fd1c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 -- 172.21.15.33:0/673215988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c8003a60 msgr2=0x7fd1c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c8003a60 0x7fd1c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 -- 172.21.15.33:0/673215988 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8003570 con 0x7fd1c8004810 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1e0b07700 1 -- 172.21.15.33:0/673215988 reap_dead start 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1c8004c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c3c0 tx=0x7fd1cc001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dd331ee519a2cbf server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00cc10 con 0x7fd1c8004810 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00cd70 con 0x7fd1c8004810 2024-08-15T17:57:10.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.560+0000 7fd1daffd700 1 -- 172.21.15.33:0/673215988 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc005b50 con 0x7fd1c8004810 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 msgr2=0x7fd1c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1c8004c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c3c0 tx=0x7fd1cc001e50 comp rx=0 tx=0).stop 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- 172.21.15.33:0/673215988 shutdown_connections 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 --2- 172.21.15.33:0/673215988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1c8004c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- 172.21.15.33:0/673215988 >> 172.21.15.33:0/673215988 conn(0x7fd1dc0678a0 msgr2=0x7fd1dc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- 172.21.15.33:0/673215988 shutdown_connections 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- 172.21.15.33:0/673215988 wait complete. 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 Processor -- start 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- start start 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1dc16a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 0x7fd1dc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1dc06d3e0 0x7fd1dc06d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc152130 con 0x7fd1dc146590 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc16ac80 con 0x7fd1c8004810 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e1308700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc06dd90 con 0x7fd1dc06d3e0 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 0x7fd1dc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1dbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1dc16a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 0x7fd1dc13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59610/0 (socket says 172.21.15.33:59610) 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 -- 172.21.15.33:0/1395268972 learned_addr learned my addr 172.21.15.33:0/1395268972 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1e0b07700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1dc06d3e0 0x7fd1dc06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 -- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1dc06d3e0 msgr2=0x7fd1dc06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1dc06d3e0 0x7fd1dc06d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 -- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 msgr2=0x7fd1dc16a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1dc16a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1db7fe700 1 -- 172.21.15.33:0/1395268972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc147710 con 0x7fd1dc146590 2024-08-15T17:57:10.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.564+0000 7fd1dbfff700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1dc16a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1db7fe700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 0x7fd1dc13b630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c2f0 tx=0x7fd1cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc022070 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc004e70 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc146b00 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00cc10 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc1470c0 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc1478a0 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1cc007530 con 0x7fd1dc146590 2024-08-15T17:57:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1d3fff700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd1bc060860 0x7fd1bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.568+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd1cc07dab0 con 0x7fd1dc146590 2024-08-15T17:57:10.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.572+0000 7fd1dbfff700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd1bc060860 0x7fd1bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.572+0000 7fd1dbfff700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd1bc060860 0x7fd1bc062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000c00 tx=0x7fd1c4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:10.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.576+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd1cc04e1a0 con 0x7fd1dc146590 2024-08-15T17:57:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.744+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd1dc064330 con 0x7fd1dc146590 2024-08-15T17:57:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.752+0000 7fd1d3fff700 1 -- 172.21.15.33:0/1395268972 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1cc0170a0 con 0x7fd1dc146590 2024-08-15T17:57:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd1bc060860 msgr2=0x7fd1bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd1bc060860 0x7fd1bc062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000c00 tx=0x7fd1c4007d30 comp rx=0 tx=0).stop 2024-08-15T17:57:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 msgr2=0x7fd1dc13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 0x7fd1dc13b630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c2f0 tx=0x7fd1cc015000 comp rx=0 tx=0).stop 2024-08-15T17:57:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 shutdown_connections 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fd1bc060860 0x7fd1bc062d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1dc06d3e0 0x7fd1dc06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1dc146590 0x7fd1dc13b630 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 --2- 172.21.15.33:0/1395268972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1c8004810 0x7fd1dc16a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 >> 172.21.15.33:0/1395268972 conn(0x7fd1dc0678a0 msgr2=0x7fd1dc067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 shutdown_connections 2024-08-15T17:57:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.756+0000 7fd1e1308700 1 -- 172.21.15.33:0/1395268972 wait complete. 2024-08-15T17:57:10.769 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-15T17:57:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.872+0000 7f14cdc20700 1 Processor -- start 2024-08-15T17:57:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.872+0000 7f14cdc20700 1 -- start start 2024-08-15T17:57:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c80aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14c80ad260 0x7f14c8157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80af850 con 0x7f14c80af420 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80ad8a0 con 0x7f14c80ad260 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80adb80 con 0x7f14c8155d80 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14c80ad260 0x7f14c8157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14c80ad260 0x7f14c8157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59612/0 (socket says 172.21.15.33:59612) 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 -- 172.21.15.33:0/3051207798 learned_addr learned my addr 172.21.15.33:0/3051207798 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14ccc1e700 1 --2- 172.21.15.33:0/3051207798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c80aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 -- 172.21.15.33:0/3051207798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 msgr2=0x7f14c80aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 --2- 172.21.15.33:0/3051207798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c80aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 -- 172.21.15.33:0/3051207798 >> v1:172.21.15.105:6789/0 conn(0x7f14c80af420 legacy=0x7f14c80acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 -- 172.21.15.33:0/3051207798 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80ade60 con 0x7f14c80ad260 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cd41f700 1 --2- 172.21.15.33:0/3051207798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8157a90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009f50 tx=0x7f14c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afec7872dc06103 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14c77fe700 1 -- 172.21.15.33:0/3051207798 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000e070 con 0x7f14c80ad260 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14c77fe700 1 -- 172.21.15.33:0/3051207798 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c000b9c0 con 0x7f14c80ad260 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14c77fe700 1 -- 172.21.15.33:0/3051207798 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00092e0 con 0x7f14c80ad260 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- 172.21.15.33:0/3051207798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 msgr2=0x7f14c8157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3051207798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8157a90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009f50 tx=0x7f14c0009840 comp rx=0 tx=0).stop 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- 172.21.15.33:0/3051207798 shutdown_connections 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3051207798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8157a90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3051207798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c80aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- 172.21.15.33:0/3051207798 >> 172.21.15.33:0/3051207798 conn(0x7f14c806e070 msgr2=0x7f14c80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- 172.21.15.33:0/3051207798 shutdown_connections 2024-08-15T17:57:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.876+0000 7f14cdc20700 1 -- 172.21.15.33:0/3051207798 wait complete. 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 Processor -- start 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- start start 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14c80af420 0x7f14c81662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c814a1d0 con 0x7f14c80ad260 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8155080 con 0x7f14c80af420 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8152d10 con 0x7f14c8155d80 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59616/0 (socket says 172.21.15.33:59616) 2024-08-15T17:57:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 -- 172.21.15.33:0/3775611112 learned_addr learned my addr 172.21.15.33:0/3775611112 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cd41f700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14c7fff700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14c80af420 0x7f14c81662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 -- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 msgr2=0x7f14c814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c814b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 -- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14c80af420 msgr2=0x7f14c81662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14c80af420 0x7f14c81662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 -- 172.21.15.33:0/3775611112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009ae0 con 0x7f14c80ad260 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14ccc1e700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8149c90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f14b800e950 tx=0x7f14b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8011790 con 0x7f14c80ad260 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b80118f0 con 0x7f14c80ad260 2024-08-15T17:57:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8011cb0 con 0x7f14c80ad260 2024-08-15T17:57:10.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c806aaa0 con 0x7f14c80ad260 2024-08-15T17:57:10.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c806b060 con 0x7f14c80ad260 2024-08-15T17:57:10.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.880+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80638f0 con 0x7f14c80ad260 2024-08-15T17:57:10.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.884+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f14b80223b0 con 0x7f14c80ad260 2024-08-15T17:57:10.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.884+0000 7f14c4ff9700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a8060860 0x7f14a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:10.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.884+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f14b807e580 con 0x7f14c80ad260 2024-08-15T17:57:10.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.884+0000 7f14c7fff700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a8060860 0x7f14a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:10.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.884+0000 7f14c7fff700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a8060860 0x7f14a8062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f14c8148540 tx=0x7f14b0007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:10.892+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f14b804ec70 con 0x7f14c80ad260 2024-08-15T17:57:11.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.112+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f14c814c5e0 con 0x7f14c80ad260 2024-08-15T17:57:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.420+0000 7f14c4ff9700 1 -- 172.21.15.33:0/3775611112 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v156) v1 ==== 135+0+0 (secure 0 0 0) 0x7f14b8052290 con 0x7f14c80ad260 2024-08-15T17:57:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a8060860 msgr2=0x7f14a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a8060860 0x7f14a8062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f14c8148540 tx=0x7f14b0007ec0 comp rx=0 tx=0).stop 2024-08-15T17:57:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 msgr2=0x7f14c8149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8149c90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f14b800e950 tx=0x7f14b80091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 shutdown_connections 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f14a8060860 0x7f14a8062d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14c80af420 0x7f14c81662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14c8155d80 0x7f14c814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 --2- 172.21.15.33:0/3775611112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c80ad260 0x7f14c8149c90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 >> 172.21.15.33:0/3775611112 conn(0x7f14c806e070 msgr2=0x7f14c80b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 shutdown_connections 2024-08-15T17:57:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:11.424+0000 7f14cdc20700 1 -- 172.21.15.33:0/3775611112 wait complete. 2024-08-15T17:57:11.443 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner: 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-15T17:57:11.444 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-15T17:57:11.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000657299 --yes-i-really-mean-it' 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner: 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner:Ran 1 test in 168.757s 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner: 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner: 2024-08-15T17:57:11.446 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-15T17:57:11.447 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-15T17:57:11.448 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-15T17:57:11.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-15T17:57:11.449 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-15T17:57:11.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-15T17:57:11.449 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-15T17:57:11.449 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000657299 --yes-i-really-mean-it' 2024-08-15T17:57:11.449 INFO:tasks.cephfs_test_runner: 2024-08-15T17:57:11.449 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-15T17:57:11.698 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f62160b82d2e4310aa75ebacbd056be3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2c991c196a651f8ef0f36c7763ec87a241b25549/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-15T17:57:11.700 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-15T17:57:11.708 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-15T17:57:11.717 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-15T17:57:11.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:11.718 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-15T17:57:11.730 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-15T17:57:11.731 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-15T17:57:11.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:11.731 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-15T17:57:11.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:11.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-15T17:57:11.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:11.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-08-15T17:57:11.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:11.942 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-08-15T17:57:11.950 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-15T17:57:11.950 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-15T17:57:11.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:11.950 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-15T17:57:12.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:12.014 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-15T17:57:12.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-15T17:57:12.031 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-08-15T17:57:12.171 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-15T17:57:12.180 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-15T17:57:12.180 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:57:12.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 Processor -- start 2024-08-15T17:57:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 -- start start 2024-08-15T17:57:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f069415aa30 0x7f069415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f06940b3b30 0x7f06940b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069415a820 con 0x7f06940aac50 2024-08-15T17:57:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069415bc90 con 0x7f069415aa30 2024-08-15T17:57:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069c6d5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940b4470 con 0x7f06940b3b30 2024-08-15T17:57:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f0699c70700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f069415aa30 0x7f069415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069a471700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06940aac50 0x7f06941574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51542/0 (socket says 172.21.15.33:51542) 2024-08-15T17:57:12.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069a471700 1 -- 172.21.15.33:0/3679008973 learned_addr learned my addr 172.21.15.33:0/3679008973 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:12.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069ac72700 1 --2- 172.21.15.33:0/3679008973 >> v2:172.21.15.105:3300/0 conn(0x7f06940b3b30 0x7f06940b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f0699c70700 1 -- 172.21.15.33:0/3679008973 >> v2:172.21.15.105:3300/0 conn(0x7f06940b3b30 msgr2=0x7f06940b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:12.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f0699c70700 1 --2- 172.21.15.33:0/3679008973 >> v2:172.21.15.105:3300/0 conn(0x7f06940b3b30 0x7f06940b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f0699c70700 1 -- 172.21.15.33:0/3679008973 >> v1:172.21.15.33:6789/0 conn(0x7f06940aac50 legacy=0x7f06941574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069946f700 1 -- 172.21.15.33:0/3679008973 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358601666 0 0) 0x7f0684004b80 con 0x7f06940aac50 2024-08-15T17:57:12.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f0699c70700 1 -- 172.21.15.33:0/3679008973 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069415b010 con 0x7f069415aa30 2024-08-15T17:57:12.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f0699c70700 1 --2- 172.21.15.33:0/3679008973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f069415aa30 0x7f069415a2e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0694159860 tx=0x7f0690009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1cd8b28f3cc731 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069946f700 1 -- 172.21.15.33:0/3679008973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000e070 con 0x7f069415aa30 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069946f700 1 -- 172.21.15.33:0/3679008973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000bb60 con 0x7f069415aa30 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.296+0000 7f069946f700 1 -- 172.21.15.33:0/3679008973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690012430 con 0x7f069415aa30 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- 172.21.15.33:0/3679008973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f069415aa30 msgr2=0x7f069415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 --2- 172.21.15.33:0/3679008973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f069415aa30 0x7f069415a2e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0694159860 tx=0x7f0690009780 comp rx=0 tx=0).stop 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- 172.21.15.33:0/3679008973 shutdown_connections 2024-08-15T17:57:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 --2- 172.21.15.33:0/3679008973 >> v2:172.21.15.105:3300/0 conn(0x7f06940b3b30 0x7f06940b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 --2- 172.21.15.33:0/3679008973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f069415aa30 0x7f069415a2e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- 172.21.15.33:0/3679008973 >> 172.21.15.33:0/3679008973 conn(0x7f06940994d0 msgr2=0x7f06940675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- 172.21.15.33:0/3679008973 shutdown_connections 2024-08-15T17:57:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- 172.21.15.33:0/3679008973 wait complete. 2024-08-15T17:57:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 Processor -- start 2024-08-15T17:57:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- start start 2024-08-15T17:57:12.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06940aac50 0x7f06940af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 0x7f069409d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069415aa30 0x7f06941522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069409da60 con 0x7f06940b3b30 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0694153460 con 0x7f069415aa30 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069409d830 con 0x7f06940aac50 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 0x7f069409d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 0x7f069409d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59632/0 (socket says 172.21.15.33:59632) 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 -- 172.21.15.33:0/4067886774 learned_addr learned my addr 172.21.15.33:0/4067886774 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069ac72700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069415aa30 0x7f06941522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069a471700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06940aac50 0x7f06940af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 -- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06940aac50 msgr2=0x7f06940af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06940aac50 0x7f06940af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 -- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069415aa30 msgr2=0x7f06941522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069415aa30 0x7f06941522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 -- 172.21.15.33:0/4067886774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009a20 con 0x7f06940b3b30 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069ac72700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069415aa30 0x7f06941522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f0699c70700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 0x7f069409d2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0694067de0 tx=0x7f0690019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690012db0 con 0x7f06940b3b30 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690027470 con 0x7f06940b3b30 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06940aee90 con 0x7f06940b3b30 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.300+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690027830 con 0x7f06940b3b30 2024-08-15T17:57:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06940ae840 con 0x7f06940b3b30 2024-08-15T17:57:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0690024070 con 0x7f06940b3b30 2024-08-15T17:57:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06940af020 con 0x7f06940b3b30 2024-08-15T17:57:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f068a7fc700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0678060860 0x7f0678062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f069007f350 con 0x7f06940b3b30 2024-08-15T17:57:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f069a471700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0678060860 0x7f0678062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.304+0000 7f069a471700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0678060860 0x7f0678062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0684007220 tx=0x7f0684009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.308+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f069004f9a0 con 0x7f06940b3b30 2024-08-15T17:57:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.475+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06940645c0 con 0x7f06940b3b30 2024-08-15T17:57:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.475+0000 7f068a7fc700 1 -- 172.21.15.33:0/4067886774 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12397 (secure 0 0 0) 0x7f0690052fc0 con 0x7f06940b3b30 2024-08-15T17:57:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:12.478 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":45,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:57:10.405372+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6836/2560726379":"2024-08-16T17:57:07.394790+0000","172.21.15.105:6834/2560726379":"2024-08-16T17:57:07.394790+0000","172.21.15.105:6837/2964556950":"2024-08-16T17:57:01.104153+0000","172.21.15.105:6835/2964556950":"2024-08-16T17:57:01.104153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:57:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0678060860 msgr2=0x7f0678062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0678060860 0x7f0678062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0684007220 tx=0x7f0684009040 comp rx=0 tx=0).stop 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 msgr2=0x7f069409d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 0x7f069409d2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0694067de0 tx=0x7f0690019000 comp rx=0 tx=0).stop 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 shutdown_connections 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0678060860 0x7f0678062d10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069415aa30 0x7f06941522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06940b3b30 0x7f069409d2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 --2- 172.21.15.33:0/4067886774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06940aac50 0x7f06940af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 >> 172.21.15.33:0/4067886774 conn(0x7f06940994d0 msgr2=0x7f0694069820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:12.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 shutdown_connections 2024-08-15T17:57:12.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.479+0000 7f069c6d5700 1 -- 172.21.15.33:0/4067886774 wait complete. 2024-08-15T17:57:12.492 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-15T17:57:12.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:57:12.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ed57fd700 1 Processor -- start 2024-08-15T17:57:12.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ed57fd700 1 -- start start 2024-08-15T17:57:12.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ed57fd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ed015d540 0x7f6ed00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ed57fd700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed00b0270 con 0x7f6ed006e830 2024-08-15T17:57:12.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ed57fd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed00af660 con 0x7f6ed00a9430 2024-08-15T17:57:12.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ed57fd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed00af940 con 0x7f6ed015d540 2024-08-15T17:57:12.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ec67fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ed006e830 0x7f6ed00a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51548/0 (socket says 172.21.15.33:51548) 2024-08-15T17:57:12.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ec67fc700 1 -- 172.21.15.33:0/104274481 learned_addr learned my addr 172.21.15.33:0/104274481 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6eceffd700 1 --2- 172.21.15.33:0/104274481 >> v2:172.21.15.105:3300/0 conn(0x7f6ed015d540 0x7f6ed00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291528693 0 0) 0x7f6ed00b0270 con 0x7f6ed006e830 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc003570 con 0x7f6ed006e830 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256763489 0 0) 0x7f6ebc003570 con 0x7f6ed006e830 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 >> v2:172.21.15.105:3300/0 conn(0x7f6ed015d540 msgr2=0x7f6ed00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 --2- 172.21.15.33:0/104274481 >> v2:172.21.15.105:3300/0 conn(0x7f6ed015d540 0x7f6ed00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 >> v1:172.21.15.105:6789/0 conn(0x7f6ed00a9430 legacy=0x7f6ed00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00afc20 con 0x7f6ed006e830 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7f6eb8001470 con 0x7f6ed006e830 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 >> v1:172.21.15.33:6789/0 conn(0x7f6ed006e830 legacy=0x7f6ed00a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc003a60 0x7f6ebc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc004810 0x7f6ebc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ebc0051c0 0x7f6ebc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00af940 con 0x7f6ebc0051c0 2024-08-15T17:57:12.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc00c0d0 con 0x7f6ebc003a60 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc00c290 con 0x7f6ebc004810 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ebc0051c0 0x7f6ebc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6eceffd700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc003a60 0x7f6ebc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.599+0000 7f6ec67fc700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc004810 0x7f6ebc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc004810 msgr2=0x7f6ebc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc004810 0x7f6ebc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc003a60 msgr2=0x7f6ebc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc003a60 0x7f6ebc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/104274481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc003570 con 0x7f6ebc0051c0 2024-08-15T17:57:12.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/104274481 reap_dead start 2024-08-15T17:57:12.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ebc0051c0 0x7f6ebc00ba60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8001fc0 tx=0x7f6ec8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe907c4d8586d1b server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8001950 con 0x7f6ebc0051c0 2024-08-15T17:57:12.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800c8b0 con 0x7f6ebc0051c0 2024-08-15T17:57:12.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ece7fc700 1 -- 172.21.15.33:0/104274481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800cc90 con 0x7f6ebc0051c0 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 -- 172.21.15.33:0/104274481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ebc0051c0 msgr2=0x7f6ebc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ebc0051c0 0x7f6ebc00ba60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8001fc0 tx=0x7f6ec8001640 comp rx=0 tx=0).stop 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 -- 172.21.15.33:0/104274481 shutdown_connections 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/104274481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ebc0051c0 0x7f6ebc00ba60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 -- 172.21.15.33:0/104274481 >> 172.21.15.33:0/104274481 conn(0x7f6ed0066e00 msgr2=0x7f6ed0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 -- 172.21.15.33:0/104274481 shutdown_connections 2024-08-15T17:57:12.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.603+0000 7f6ed57fd700 1 -- 172.21.15.33:0/104274481 wait complete. 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 Processor -- start 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 -- start start 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0051c0 0x7f6ed00ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ed0161360 0x7f6ed00984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 0x7f6ed0159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00abb20 con 0x7f6ed0098a20 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c8290 con 0x7f6ed0161360 2024-08-15T17:57:12.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00ac9e0 con 0x7f6ebc0051c0 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 0x7f6ed0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 0x7f6ed0159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59638/0 (socket says 172.21.15.33:59638) 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/2794980520 learned_addr learned my addr 172.21.15.33:0/2794980520 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6eceffd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0051c0 0x7f6ed00ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ec67fc700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ed0161360 0x7f6ed00984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0051c0 msgr2=0x7f6ed00ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0051c0 0x7f6ed00ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ed0161360 msgr2=0x7f6ed00984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ed0161360 0x7f6ed00984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 -- 172.21.15.33:0/2794980520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00aaf10 con 0x7f6ed0098a20 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ecf7fe700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 0x7f6ed0159730 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6ed01623b0 tx=0x7f6ec8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8001950 con 0x7f6ed0098a20 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800c6d0 con 0x7f6ed0098a20 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed00ab1f0 con 0x7f6ed0098a20 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec801e850 con 0x7f6ed0098a20 2024-08-15T17:57:12.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.607+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed00ab7b0 con 0x7f6ed0098a20 2024-08-15T17:57:12.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.611+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed016da70 con 0x7f6ed0098a20 2024-08-15T17:57:12.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.611+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ec801ec40 con 0x7f6ed0098a20 2024-08-15T17:57:12.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.611+0000 7f6ec77fe700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6eb0060860 0x7f6eb0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.611+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ec807e390 con 0x7f6ed0098a20 2024-08-15T17:57:12.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.611+0000 7f6eceffd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6eb0060860 0x7f6eb0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.611+0000 7f6eceffd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6eb0060860 0x7f6eb0062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006f00 tx=0x7f6ec00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.619+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ed016da70 con 0x7f6ed0098a20 2024-08-15T17:57:12.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.779+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ed016da70 con 0x7f6eb0060860 2024-08-15T17:57:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.787+0000 7f6ec77fe700 1 -- 172.21.15.33:0/2794980520 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49157 (secure 0 0 0) 0x7f6ed016da70 con 0x7f6eb0060860 2024-08-15T17:57:12.790 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:12.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6eb0060860 msgr2=0x7f6eb0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6eb0060860 0x7f6eb0062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006f00 tx=0x7f6ec00091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 msgr2=0x7f6ed0159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 0x7f6ed0159730 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6ed01623b0 tx=0x7f6ec8015000 comp rx=0 tx=0).stop 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 shutdown_connections 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6eb0060860 0x7f6eb0062d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ed0161360 0x7f6ed00984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed0098a20 0x7f6ed0159730 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 --2- 172.21.15.33:0/2794980520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0051c0 0x7f6ed00ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 >> 172.21.15.33:0/2794980520 conn(0x7f6ed0066e00 msgr2=0x7f6ed0067300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 shutdown_connections 2024-08-15T17:57:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.791+0000 7f6ed57fd700 1 -- 172.21.15.33:0/2794980520 wait complete. 2024-08-15T17:57:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:57:12.805 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-15T17:57:12.317147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392452,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582268,"statfs":{"total":773094113280,"available":770644242432,"internally_reserved":0,"allocated":5382144,"data_stored":2958312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001792"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-15T17:57:09.410753+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:57:09.410753+0000","last_peered":"2024-08-15T17:57:09.410753+0000","last_clean":"2024-08-15T17:57:09.410753+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:57:09.410753+0000","last_undegraded":"2024-08-15T17:57:09.410753+0000","last_fullsized":"2024-08-15T17:57:09.410753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.054,"15min":1.054},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.754},"min":{"1min":0.628,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.61599999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.216,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.0760000000000001,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.0149999999999999,"15min":1.0589999999999999},"min":{"1min":0.78700000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0740000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.23}]},{"osd":4,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.78400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3859999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.355},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.76500000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4259999999999999,"5min":1.629,"15min":1.629},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.2390000000000001},"min":{"1min":0.94999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.373,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.133},"min":{"1min":0.874,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3520000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.038}]},{"osd":6,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":1.0609999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.401,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2769999999999999,"15min":1.2969999999999999},"min":{"1min":1.0089999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4670000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.371}]},{"osd":7,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.256},"min":{"1min":0.90000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.444,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":1.22},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.248},"min":{"1min":1.0309999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4750000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.0149999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.018,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.66600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0489999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.71699999999999997},"min":{"1min":0.55600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85899999999999999,"5min":1.409,"15min":1.409},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.028,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.147,"5min":1.218,"15min":1.218},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":0.995},"min":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2210000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.0629999999999999,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.266,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.115,"15min":1.147},"min":{"1min":0.872,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4419999999999999,"5min":1.992,"15min":1.992},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.095,"15min":1.105},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3009999999999999,"5min":1.367,"15min":1.367},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.226,"5min":1.532,"15min":1.532},"last":1.349},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.248,"15min":1.284},"min":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1830000000000001,"15min":1.1850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.3300000000000001,"5min":1.446,"15min":1.446},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.94599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.593,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.1559999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.879}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.746},"min":{"1min":0.57799999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.21,"5min":1.54,"15min":1.54},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.113},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.339,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.82299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.177,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0800000000000001,"15min":1.107},"min":{"1min":0.755,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2829999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.222},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1719999999999999,"15min":1.1839999999999999},"min":{"1min":0.86799999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.365,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.494,"5min":1.829,"15min":1.829},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.242,"15min":1.2849999999999999},"min":{"1min":0.84899999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.46,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.296}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.284,"15min":1.3260000000000001},"min":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5580000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.212,"15min":1.232},"min":{"1min":1.02,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5600000000000001,"5min":2.109,"15min":2.109},"last":1.444}]}]},{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":217961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.88100000000000001,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0149999999999999,"15min":1.002},"min":{"1min":0.67500000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.248,"5min":1.377,"15min":1.377},"last":0.877}]},{"osd":1,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2589999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.65900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2390000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.222}]},{"osd":2,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.262,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91300000000000003,"15min":0.89900000000000002},"min":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.359,"15min":1.359},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.61799999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.224,"5min":1.389,"15min":1.389},"last":1.321},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0660000000000001,"15min":1.073},"min":{"1min":0.71799999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.274,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0840000000000001}]},{"osd":4,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2050000000000001,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.71399999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.234,"5min":1.508,"15min":1.508},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.67100000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.3500000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1279999999999999,"15min":1.1259999999999999},"min":{"1min":0.84799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":1.3129999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.306,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.25},{"interface":"front","average":{"1min":1.21,"5min":1.2250000000000001,"15min":1.2450000000000001},"min":{"1min":0.90000000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4179999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3819999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.97499999999999998,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.264,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93300000000000005,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.01,"5min":0.89500000000000002,"15min":0.85299999999999998},"min":{"1min":0.66400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92100000000000004,"15min":0.93300000000000005},"min":{"1min":0.71799999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.226,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.008,"15min":1.016},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2929999999999999,"5min":1.694,"15min":1.694},"last":1.145}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0289999999999999},"min":{"1min":0.71899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.71599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":0.98599999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1559999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.109,"15min":1.097},"min":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6040000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.1639999999999999},"min":{"1min":0.98999999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4550000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.875}]}]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2250000000000001,"5min":1.238,"15min":1.238},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.65300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94499999999999995,"15min":0.91300000000000003},"min":{"1min":0.74399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.95599999999999996},"min":{"1min":0.77800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.409}]},{"osd":2,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.71099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.181,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92400000000000004,"15min":0.91700000000000004},"min":{"1min":0.66800000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.173,"5min":1.242,"15min":1.242},"last":1.4870000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.94899999999999995},"min":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2230000000000001,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0169999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1870000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2929999999999999,"5min":1.532,"15min":1.532},"last":1.101},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.88500000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.542}]},{"osd":6,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.72899999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.103,"15min":1.111},"min":{"1min":0.69799999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.119,"15min":1.131},"min":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.331},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1619999999999999,"15min":1.1819999999999999},"min":{"1min":0.88100000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4570000000000001,"5min":1.595,"15min":1.595},"last":1.585}]}]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.90100000000000002},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.095,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.95599999999999996},"min":{"1min":0.63800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.95199999999999996,"15min":0.92600000000000005},"min":{"1min":0.84499999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.996,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.363,"5min":1.659,"15min":1.659},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98399999999999999,"15min":0.97799999999999998},"min":{"1min":0.68899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.034,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.091,"15min":1.117},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.605,"15min":1.605},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0189999999999999,"15min":1.0349999999999999},"min":{"1min":0.76100000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.425,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.006,"15min":1.0229999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1819999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6839999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.139},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.466,"5min":1.544,"15min":1.544},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1919999999999999,"15min":1.216},"min":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.5,"5min":1.671,"15min":1.671},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.272,"15min":1.28},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.639,"5min":1.758,"15min":1.758},"last":0.93600000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":808329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72799999999999998,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.70799999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.2410000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.64600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":1.276,"15min":1.276},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5860000000000001,"5min":2.355,"15min":2.355},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.91700000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.173,"15min":1.175},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.399,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.097,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4039999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.006}]},{"osd":6,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.583,"5min":1.774,"15min":1.774},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2569999999999999,"15min":1.2529999999999999},"min":{"1min":1.0740000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.4590000000000001,"5min":1.645,"15min":1.645},"last":1.143}]},{"osd":7,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.232,"15min":1.234},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.506,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":1.0489999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0940000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:57:12.806 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:57:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 Processor -- start 2024-08-15T17:57:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- start start 2024-08-15T17:57:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f06bc15d540 0x7f06bc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc0a9430 0x7f06bc0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0b0270 con 0x7f06bc06e830 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06bc0af660 con 0x7f06bc15d540 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0af940 con 0x7f06bc0a9430 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b9d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06bc06e830 0x7f06bc0a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51552/0 (socket says 172.21.15.33:51552) 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b9d9b700 1 -- 172.21.15.33:0/1108502267 learned_addr learned my addr 172.21.15.33:0/1108502267 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06ba59c700 1 --2- 172.21.15.33:0/1108502267 >> v2:172.21.15.105:3300/0 conn(0x7f06bc15d540 0x7f06bc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06bad9d700 1 --2- 172.21.15.33:0/1108502267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc0a9430 0x7f06bc0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b959a700 1 -- 172.21.15.33:0/1108502267 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290271182 0 0) 0x7f06bc0b0270 con 0x7f06bc06e830 2024-08-15T17:57:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b959a700 1 -- 172.21.15.33:0/1108502267 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a8003570 con 0x7f06bc06e830 2024-08-15T17:57:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06bad9d700 1 -- 172.21.15.33:0/1108502267 >> v2:172.21.15.105:3300/0 conn(0x7f06bc15d540 msgr2=0x7f06bc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06bad9d700 1 --2- 172.21.15.33:0/1108502267 >> v2:172.21.15.105:3300/0 conn(0x7f06bc15d540 0x7f06bc0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06bad9d700 1 -- 172.21.15.33:0/1108502267 >> v1:172.21.15.33:6789/0 conn(0x7f06bc06e830 legacy=0x7f06bc0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06bad9d700 1 -- 172.21.15.33:0/1108502267 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0afc20 con 0x7f06bc0a9430 2024-08-15T17:57:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06ba59c700 1 --2- 172.21.15.33:0/1108502267 >> v2:172.21.15.105:3300/0 conn(0x7f06bc15d540 0x7f06bc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:12.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06bad9d700 1 --2- 172.21.15.33:0/1108502267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc0a9430 0x7f06bc0b0700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0098e0 tx=0x7f06ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d1aa85cedde9e2a server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b959a700 1 -- 172.21.15.33:0/1108502267 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac011630 con 0x7f06bc0a9430 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b959a700 1 -- 172.21.15.33:0/1108502267 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac011790 con 0x7f06bc0a9430 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06b959a700 1 -- 172.21.15.33:0/1108502267 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac011b30 con 0x7f06bc0a9430 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- 172.21.15.33:0/1108502267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc0a9430 msgr2=0x7f06bc0b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 --2- 172.21.15.33:0/1108502267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc0a9430 0x7f06bc0b0700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0098e0 tx=0x7f06ac0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- 172.21.15.33:0/1108502267 shutdown_connections 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 --2- 172.21.15.33:0/1108502267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc0a9430 0x7f06bc0b0700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 --2- 172.21.15.33:0/1108502267 >> v2:172.21.15.105:3300/0 conn(0x7f06bc15d540 0x7f06bc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.915+0000 7f06c0e22700 1 -- 172.21.15.33:0/1108502267 >> 172.21.15.33:0/1108502267 conn(0x7f06bc066e00 msgr2=0x7f06bc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 -- 172.21.15.33:0/1108502267 shutdown_connections 2024-08-15T17:57:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 -- 172.21.15.33:0/1108502267 wait complete. 2024-08-15T17:57:12.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 Processor -- start 2024-08-15T17:57:12.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 -- start start 2024-08-15T17:57:12.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 0x7f06bc0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06bc0a9430 0x7f06bc097f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc15d540 0x7f06bc158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc16d540 con 0x7f06bc06e830 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0ad0e0 con 0x7f06bc0a9430 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06c0e22700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0abad0 con 0x7f06bc15d540 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 0x7f06bc0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 0x7f06bc0acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59642/0 (socket says 172.21.15.33:59642) 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.919+0000 7f06ba59c700 1 -- 172.21.15.33:0/68687789 learned_addr learned my addr 172.21.15.33:0/68687789 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:12.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06b9d9b700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06bc0a9430 0x7f06bc097f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06bad9d700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc15d540 0x7f06bc158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06ba59c700 1 -- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc15d540 msgr2=0x7f06bc158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06ba59c700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc15d540 0x7f06bc158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06ba59c700 1 -- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06bc0a9430 msgr2=0x7f06bc097f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06ba59c700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06bc0a9430 0x7f06bc097f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06ba59c700 1 -- 172.21.15.33:0/68687789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009420 con 0x7f06bc06e830 2024-08-15T17:57:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06b9d9b700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06bc0a9430 0x7f06bc097f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06ba59c700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 0x7f06bc0acba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f06a400ec80 tx=0x7f06a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400c970 con 0x7f06bc06e830 2024-08-15T17:57:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a400cad0 con 0x7f06bc06e830 2024-08-15T17:57:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac009420 con 0x7f06bc06e830 2024-08-15T17:57:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400ce50 con 0x7f06bc06e830 2024-08-15T17:57:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc0ac090 con 0x7f06bc06e830 2024-08-15T17:57:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc0645c0 con 0x7f06bc06e830 2024-08-15T17:57:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.923+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f06a4013680 con 0x7f06bc06e830 2024-08-15T17:57:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.927+0000 7f06b27fc700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f069c060860 0x7f069c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.927+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f06a407cbe0 con 0x7f06bc06e830 2024-08-15T17:57:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.927+0000 7f06b9d9b700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f069c060860 0x7f069c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.927+0000 7f06b9d9b700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f069c060860 0x7f069c062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f06bc159d40 tx=0x7f06b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:12.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:12.935+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f06a404d2d0 con 0x7f06bc06e830 2024-08-15T17:57:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.095+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06bc06f360 con 0x7f069c060860 2024-08-15T17:57:13.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06b27fc700 1 -- 172.21.15.33:0/68687789 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49157 (secure 0 0 0) 0x7f06bc06f360 con 0x7f069c060860 2024-08-15T17:57:13.105 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f069c060860 msgr2=0x7f069c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f069c060860 0x7f069c062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f06bc159d40 tx=0x7f06b4009040 comp rx=0 tx=0).stop 2024-08-15T17:57:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 msgr2=0x7f06bc0acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 0x7f06bc0acba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f06a400ec80 tx=0x7f06a40091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 shutdown_connections 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f069c060860 0x7f069c062d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06bc0a9430 0x7f06bc097f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06bc15d540 0x7f06bc158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 --2- 172.21.15.33:0/68687789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06bc06e830 0x7f06bc0acba0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.103+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 >> 172.21.15.33:0/68687789 conn(0x7f06bc066e00 msgr2=0x7f06bc15a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.107+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 shutdown_connections 2024-08-15T17:57:13.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.107+0000 7f06c0e22700 1 -- 172.21.15.33:0/68687789 wait complete. 2024-08-15T17:57:13.109 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:57:13.124 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-15T17:57:12.317147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392452,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582268,"statfs":{"total":773094113280,"available":770644242432,"internally_reserved":0,"allocated":5382144,"data_stored":2958312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001792"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-15T17:57:09.410753+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:57:09.410753+0000","last_peered":"2024-08-15T17:57:09.410753+0000","last_clean":"2024-08-15T17:57:09.410753+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:57:09.410753+0000","last_undegraded":"2024-08-15T17:57:09.410753+0000","last_fullsized":"2024-08-15T17:57:09.410753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.054,"15min":1.054},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.754},"min":{"1min":0.628,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.61599999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.216,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.0760000000000001,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.0149999999999999,"15min":1.0589999999999999},"min":{"1min":0.78700000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0740000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.23}]},{"osd":4,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.78400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3859999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.355},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.76500000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4259999999999999,"5min":1.629,"15min":1.629},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.2390000000000001},"min":{"1min":0.94999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.373,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.133},"min":{"1min":0.874,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3520000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.038}]},{"osd":6,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":1.0609999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.401,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2769999999999999,"15min":1.2969999999999999},"min":{"1min":1.0089999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4670000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.371}]},{"osd":7,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.256},"min":{"1min":0.90000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.444,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":1.22},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.248},"min":{"1min":1.0309999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4750000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.0149999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.018,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.66600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0489999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.71699999999999997},"min":{"1min":0.55600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85899999999999999,"5min":1.409,"15min":1.409},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.028,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.147,"5min":1.218,"15min":1.218},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":0.995},"min":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2210000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.0629999999999999,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.266,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.115,"15min":1.147},"min":{"1min":0.872,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4419999999999999,"5min":1.992,"15min":1.992},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.095,"15min":1.105},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3009999999999999,"5min":1.367,"15min":1.367},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.226,"5min":1.532,"15min":1.532},"last":1.349},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.248,"15min":1.284},"min":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1830000000000001,"15min":1.1850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.3300000000000001,"5min":1.446,"15min":1.446},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.94599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.593,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.1559999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.879}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.746},"min":{"1min":0.57799999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.21,"5min":1.54,"15min":1.54},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.113},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.339,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.82299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.177,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0800000000000001,"15min":1.107},"min":{"1min":0.755,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2829999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.222},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1719999999999999,"15min":1.1839999999999999},"min":{"1min":0.86799999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.365,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.494,"5min":1.829,"15min":1.829},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.242,"15min":1.2849999999999999},"min":{"1min":0.84899999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.46,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.296}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.284,"15min":1.3260000000000001},"min":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5580000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.212,"15min":1.232},"min":{"1min":1.02,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5600000000000001,"5min":2.109,"15min":2.109},"last":1.444}]}]},{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":217961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.88100000000000001,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0149999999999999,"15min":1.002},"min":{"1min":0.67500000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.248,"5min":1.377,"15min":1.377},"last":0.877}]},{"osd":1,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2589999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.65900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2390000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.222}]},{"osd":2,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.262,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91300000000000003,"15min":0.89900000000000002},"min":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.359,"15min":1.359},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.61799999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.224,"5min":1.389,"15min":1.389},"last":1.321},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0660000000000001,"15min":1.073},"min":{"1min":0.71799999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.274,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0840000000000001}]},{"osd":4,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2050000000000001,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.71399999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.234,"5min":1.508,"15min":1.508},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.67100000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.3500000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1279999999999999,"15min":1.1259999999999999},"min":{"1min":0.84799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":1.3129999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.306,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.25},{"interface":"front","average":{"1min":1.21,"5min":1.2250000000000001,"15min":1.2450000000000001},"min":{"1min":0.90000000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4179999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3819999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.97499999999999998,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.264,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93300000000000005,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.01,"5min":0.89500000000000002,"15min":0.85299999999999998},"min":{"1min":0.66400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92100000000000004,"15min":0.93300000000000005},"min":{"1min":0.71799999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.226,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.008,"15min":1.016},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2929999999999999,"5min":1.694,"15min":1.694},"last":1.145}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0289999999999999},"min":{"1min":0.71899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.71599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":0.98599999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1559999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.109,"15min":1.097},"min":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6040000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.1639999999999999},"min":{"1min":0.98999999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4550000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.875}]}]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2250000000000001,"5min":1.238,"15min":1.238},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.65300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94499999999999995,"15min":0.91300000000000003},"min":{"1min":0.74399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.95599999999999996},"min":{"1min":0.77800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.409}]},{"osd":2,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.71099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.181,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92400000000000004,"15min":0.91700000000000004},"min":{"1min":0.66800000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.173,"5min":1.242,"15min":1.242},"last":1.4870000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.94899999999999995},"min":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2230000000000001,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0169999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1870000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2929999999999999,"5min":1.532,"15min":1.532},"last":1.101},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.88500000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.542}]},{"osd":6,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.72899999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.103,"15min":1.111},"min":{"1min":0.69799999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.119,"15min":1.131},"min":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.331},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1619999999999999,"15min":1.1819999999999999},"min":{"1min":0.88100000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4570000000000001,"5min":1.595,"15min":1.595},"last":1.585}]}]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.90100000000000002},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.095,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.95599999999999996},"min":{"1min":0.63800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.95199999999999996,"15min":0.92600000000000005},"min":{"1min":0.84499999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.996,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.363,"5min":1.659,"15min":1.659},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98399999999999999,"15min":0.97799999999999998},"min":{"1min":0.68899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.034,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.091,"15min":1.117},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.605,"15min":1.605},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0189999999999999,"15min":1.0349999999999999},"min":{"1min":0.76100000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.425,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.006,"15min":1.0229999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1819999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6839999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.139},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.466,"5min":1.544,"15min":1.544},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1919999999999999,"15min":1.216},"min":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.5,"5min":1.671,"15min":1.671},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.272,"15min":1.28},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.639,"5min":1.758,"15min":1.758},"last":0.93600000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":808329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72799999999999998,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.70799999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.2410000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.64600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":1.276,"15min":1.276},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5860000000000001,"5min":2.355,"15min":2.355},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.91700000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.173,"15min":1.175},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.399,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.097,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4039999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.006}]},{"osd":6,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.583,"5min":1.774,"15min":1.774},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2569999999999999,"15min":1.2529999999999999},"min":{"1min":1.0740000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.4590000000000001,"5min":1.645,"15min":1.645},"last":1.143}]},{"osd":7,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.232,"15min":1.234},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.506,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":1.0489999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0940000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:57:13.125 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-15T17:57:13.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:57:13.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 Processor -- start 2024-08-15T17:57:13.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 -- start start 2024-08-15T17:57:13.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f58740af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f587406e830 0x7f58740a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740b0270 con 0x7f58740a9260 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58740af660 con 0x7f587406e830 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740af940 con 0x7f587415d540 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f58796ef700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f58740af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f587406e830 0x7f58740a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f58796ef700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f58740af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.33:48130/0 (socket says 172.21.15.33:48130) 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f587406e830 0x7f58740a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:53526/0 (socket says 172.21.15.33:53526) 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f58796ef700 1 -- 172.21.15.33:0/1211853256 learned_addr learned my addr 172.21.15.33:0/1211853256 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5879ef0700 1 --1- 172.21.15.33:0/1211853256 >> v1:172.21.15.105:6789/0 conn(0x7f58740a9260 0x7f58740b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:33496/0 (socket says 172.21.15.33:33496) 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 -- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 msgr2=0x7f58740af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 --2- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f58740af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 -- 172.21.15.33:0/1211853256 >> v1:172.21.15.105:6789/0 conn(0x7f58740a9260 legacy=0x7f58740b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 -- 172.21.15.33:0/1211853256 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740afc20 con 0x7f587406e830 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f5878eee700 1 --2- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f58740a8d20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f58700098e0 tx=0x7f58700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=758f0bdf2e6e8df0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f586bfff700 1 -- 172.21.15.33:0/1211853256 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000b640 con 0x7f587406e830 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f586bfff700 1 -- 172.21.15.33:0/1211853256 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587000b7a0 con 0x7f587406e830 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f586bfff700 1 -- 172.21.15.33:0/1211853256 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000bb40 con 0x7f587406e830 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 -- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 msgr2=0x7f58740a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.235+0000 7f587b953700 1 --2- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f58740a8d20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f58700098e0 tx=0x7f58700091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- 172.21.15.33:0/1211853256 shutdown_connections 2024-08-15T17:57:13.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 --2- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f58740a8d20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 --2- 172.21.15.33:0/1211853256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f58740af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- 172.21.15.33:0/1211853256 >> 172.21.15.33:0/1211853256 conn(0x7f5874066e00 msgr2=0x7f5874067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:13.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- 172.21.15.33:0/1211853256 shutdown_connections 2024-08-15T17:57:13.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- 172.21.15.33:0/1211853256 wait complete. 2024-08-15T17:57:13.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 Processor -- start 2024-08-15T17:57:13.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- start start 2024-08-15T17:57:13.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f587416d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58740a9260 0x7f5874098e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f5874170600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5874171d80 con 0x7f58740a9260 2024-08-15T17:57:13.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c8f30 con 0x7f587406e830 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f587b953700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5874099380 con 0x7f587415d540 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f5878eee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58740a9260 0x7f5874098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f58796ef700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f587416d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f5878eee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58740a9260 0x7f5874098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59644/0 (socket says 172.21.15.33:59644) 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f5878eee700 1 -- 172.21.15.33:0/1909802222 learned_addr learned my addr 172.21.15.33:0/1909802222 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f5879ef0700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f5874170600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f58796ef700 1 -- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 msgr2=0x7f5874170600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f58796ef700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f5874170600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f58796ef700 1 -- 172.21.15.33:0/1909802222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58740a9260 msgr2=0x7f5874098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f58796ef700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58740a9260 0x7f5874098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.239+0000 7f58796ef700 1 -- 172.21.15.33:0/1909802222 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870009420 con 0x7f587406e830 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f58796ef700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f587416d960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f586400e8d0 tx=0x7f5864009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864013680 con 0x7f587406e830 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58740c8320 con 0x7f587406e830 2024-08-15T17:57:13.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640137e0 con 0x7f587406e830 2024-08-15T17:57:13.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58740c88e0 con 0x7f587406e830 2024-08-15T17:57:13.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864013b60 con 0x7f587406e830 2024-08-15T17:57:13.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58540052b0 con 0x7f587406e830 2024-08-15T17:57:13.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.243+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5864026480 con 0x7f587406e830 2024-08-15T17:57:13.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.247+0000 7f58697fa700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5858060860 0x7f5858062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.247+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f586407d0f0 con 0x7f587406e830 2024-08-15T17:57:13.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.247+0000 7f5878eee700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5858060860 0x7f5858062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.247+0000 7f5878eee700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5858060860 0x7f5858062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5874098d00 tx=0x7f5870017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:13.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.255+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f586404d7e0 con 0x7f587406e830 2024-08-15T17:57:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.415+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5854000bc0 con 0x7f5858060860 2024-08-15T17:57:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.419+0000 7f58697fa700 1 -- 172.21.15.33:0/1909802222 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49157 (secure 0 0 0) 0x7f5854000bc0 con 0x7f5858060860 2024-08-15T17:57:13.422 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:13.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.419+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5858060860 msgr2=0x7f5858062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.419+0000 7f587b953700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5858060860 0x7f5858062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5874098d00 tx=0x7f5870017000 comp rx=0 tx=0).stop 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 msgr2=0x7f587416d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f587416d960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f586400e8d0 tx=0x7f5864009250 comp rx=0 tx=0).stop 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 shutdown_connections 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f5858060860 0x7f5858062d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f587415d540 0x7f5874170600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58740a9260 0x7f5874098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 --2- 172.21.15.33:0/1909802222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f587406e830 0x7f587416d960 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 >> 172.21.15.33:0/1909802222 conn(0x7f5874066e00 msgr2=0x7f58740b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:13.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 shutdown_connections 2024-08-15T17:57:13.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.423+0000 7f587b953700 1 -- 172.21.15.33:0/1909802222 wait complete. 2024-08-15T17:57:13.425 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:57:13.437 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-15T17:57:12.317147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392452,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582268,"statfs":{"total":773094113280,"available":770644242432,"internally_reserved":0,"allocated":5382144,"data_stored":2958312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001792"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-15T17:57:09.410753+0000","last_change":"2024-08-15T17:53:37.821216+0000","last_active":"2024-08-15T17:57:09.410753+0000","last_peered":"2024-08-15T17:57:09.410753+0000","last_clean":"2024-08-15T17:57:09.410753+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:57:09.410753+0000","last_undegraded":"2024-08-15T17:57:09.410753+0000","last_fullsized":"2024-08-15T17:57:09.410753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-17T01:56:20.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.054,"15min":1.054},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.754},"min":{"1min":0.628,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.61599999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.216,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.0760000000000001,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.0149999999999999,"15min":1.0589999999999999},"min":{"1min":0.78700000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0740000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.23}]},{"osd":4,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.78400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3859999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.355},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.76500000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4259999999999999,"5min":1.629,"15min":1.629},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.2390000000000001},"min":{"1min":0.94999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.373,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.133},"min":{"1min":0.874,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3520000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.038}]},{"osd":6,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":1.0609999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.401,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2769999999999999,"15min":1.2969999999999999},"min":{"1min":1.0089999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4670000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.371}]},{"osd":7,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.256},"min":{"1min":0.90000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.444,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":1.22},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.248},"min":{"1min":1.0309999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4750000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.0149999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.018,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.66600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0489999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.71699999999999997},"min":{"1min":0.55600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85899999999999999,"5min":1.409,"15min":1.409},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.028,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.147,"5min":1.218,"15min":1.218},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":0.995},"min":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2210000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.0629999999999999,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.266,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.115,"15min":1.147},"min":{"1min":0.872,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4419999999999999,"5min":1.992,"15min":1.992},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.095,"15min":1.105},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3009999999999999,"5min":1.367,"15min":1.367},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.226,"5min":1.532,"15min":1.532},"last":1.349},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.248,"15min":1.284},"min":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1830000000000001,"15min":1.1850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.3300000000000001,"5min":1.446,"15min":1.446},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.94599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.593,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.1559999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.879}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.746},"min":{"1min":0.57799999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.21,"5min":1.54,"15min":1.54},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.113},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.339,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.82299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.177,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0800000000000001,"15min":1.107},"min":{"1min":0.755,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2829999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.222},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1719999999999999,"15min":1.1839999999999999},"min":{"1min":0.86799999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.365,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.494,"5min":1.829,"15min":1.829},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.242,"15min":1.2849999999999999},"min":{"1min":0.84899999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.46,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.296}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.284,"15min":1.3260000000000001},"min":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5580000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.212,"15min":1.232},"min":{"1min":1.02,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5600000000000001,"5min":2.109,"15min":2.109},"last":1.444}]}]},{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":217961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.88100000000000001,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0149999999999999,"15min":1.002},"min":{"1min":0.67500000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.248,"5min":1.377,"15min":1.377},"last":0.877}]},{"osd":1,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2589999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.65900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2390000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.222}]},{"osd":2,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.262,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91300000000000003,"15min":0.89900000000000002},"min":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.359,"15min":1.359},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.61799999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.224,"5min":1.389,"15min":1.389},"last":1.321},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0660000000000001,"15min":1.073},"min":{"1min":0.71799999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.274,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0840000000000001}]},{"osd":4,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2050000000000001,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.71399999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.234,"5min":1.508,"15min":1.508},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.67100000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.3500000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1279999999999999,"15min":1.1259999999999999},"min":{"1min":0.84799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":1.3129999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.306,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.25},{"interface":"front","average":{"1min":1.21,"5min":1.2250000000000001,"15min":1.2450000000000001},"min":{"1min":0.90000000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4179999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3819999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.97499999999999998,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.264,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93300000000000005,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.01,"5min":0.89500000000000002,"15min":0.85299999999999998},"min":{"1min":0.66400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92100000000000004,"15min":0.93300000000000005},"min":{"1min":0.71799999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.226,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.008,"15min":1.016},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2929999999999999,"5min":1.694,"15min":1.694},"last":1.145}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0289999999999999},"min":{"1min":0.71899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.71599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":0.98599999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1559999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.109,"15min":1.097},"min":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6040000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.1639999999999999},"min":{"1min":0.98999999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4550000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.875}]}]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2250000000000001,"5min":1.238,"15min":1.238},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.65300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94499999999999995,"15min":0.91300000000000003},"min":{"1min":0.74399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.95599999999999996},"min":{"1min":0.77800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.409}]},{"osd":2,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.71099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.181,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92400000000000004,"15min":0.91700000000000004},"min":{"1min":0.66800000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.173,"5min":1.242,"15min":1.242},"last":1.4870000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.94899999999999995},"min":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2230000000000001,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0169999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1870000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2929999999999999,"5min":1.532,"15min":1.532},"last":1.101},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.88500000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.542}]},{"osd":6,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.72899999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.103,"15min":1.111},"min":{"1min":0.69799999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.119,"15min":1.131},"min":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.331},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1619999999999999,"15min":1.1819999999999999},"min":{"1min":0.88100000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4570000000000001,"5min":1.595,"15min":1.595},"last":1.585}]}]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.90100000000000002},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.095,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.95599999999999996},"min":{"1min":0.63800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.95199999999999996,"15min":0.92600000000000005},"min":{"1min":0.84499999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.996,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.363,"5min":1.659,"15min":1.659},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98399999999999999,"15min":0.97799999999999998},"min":{"1min":0.68899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.034,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.091,"15min":1.117},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.605,"15min":1.605},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0189999999999999,"15min":1.0349999999999999},"min":{"1min":0.76100000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.425,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.006,"15min":1.0229999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1819999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6839999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.139},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.466,"5min":1.544,"15min":1.544},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1919999999999999,"15min":1.216},"min":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.5,"5min":1.671,"15min":1.671},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.272,"15min":1.28},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.639,"5min":1.758,"15min":1.758},"last":0.93600000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":808329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72799999999999998,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.70799999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.2410000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.64600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":1.276,"15min":1.276},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5860000000000001,"5min":2.355,"15min":2.355},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.91700000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.173,"15min":1.175},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.399,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.097,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4039999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.006}]},{"osd":6,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.583,"5min":1.774,"15min":1.774},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2569999999999999,"15min":1.2529999999999999},"min":{"1min":1.0740000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.4590000000000001,"5min":1.645,"15min":1.645},"last":1.143}]},{"osd":7,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.232,"15min":1.234},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.506,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":1.0489999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0940000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:57:13.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-15T17:57:13.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.543+0000 7ff66a8f3700 1 Processor -- start 2024-08-15T17:57:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.543+0000 7ff66a8f3700 1 -- start start 2024-08-15T17:57:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6640b0350 0x7ff6640ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff66406df10 0x7ff66406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66406e870 con 0x7ff664155d20 2024-08-15T17:57:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6640b07a0 con 0x7ff66406df10 2024-08-15T17:57:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6640af2b0 con 0x7ff6640b0350 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a0f2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff66406df10 0x7ff66406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6698f1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff664155d20 0x7ff6640aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51566/0 (socket says 172.21.15.33:51566) 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6698f1700 1 -- 172.21.15.33:0/456116771 learned_addr learned my addr 172.21.15.33:0/456116771 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6690f0700 1 --2- 172.21.15.33:0/456116771 >> v2:172.21.15.105:3300/0 conn(0x7ff6640b0350 0x7ff6640ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6688ef700 1 -- 172.21.15.33:0/456116771 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576416736 0 0) 0x7ff66406e870 con 0x7ff664155d20 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6688ef700 1 -- 172.21.15.33:0/456116771 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff64c003570 con 0x7ff664155d20 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6690f0700 1 -- 172.21.15.33:0/456116771 >> v2:172.21.15.33:3300/0 conn(0x7ff66406df10 msgr2=0x7ff66406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6690f0700 1 --2- 172.21.15.33:0/456116771 >> v2:172.21.15.33:3300/0 conn(0x7ff66406df10 0x7ff66406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6690f0700 1 -- 172.21.15.33:0/456116771 >> v1:172.21.15.33:6789/0 conn(0x7ff664155d20 legacy=0x7ff6640aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6690f0700 1 -- 172.21.15.33:0/456116771 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6640af590 con 0x7ff6640b0350 2024-08-15T17:57:13.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6690f0700 1 --2- 172.21.15.33:0/456116771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff6640ad7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff66406fb30 tx=0x7ff6600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27af1942128abf15 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:13.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6688ef700 1 -- 172.21.15.33:0/456116771 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660011630 con 0x7ff6640b0350 2024-08-15T17:57:13.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6688ef700 1 -- 172.21.15.33:0/456116771 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff660011790 con 0x7ff6640b0350 2024-08-15T17:57:13.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff6688ef700 1 -- 172.21.15.33:0/456116771 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660011b30 con 0x7ff6640b0350 2024-08-15T17:57:13.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- 172.21.15.33:0/456116771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 msgr2=0x7ff6640ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/456116771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff6640ad7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff66406fb30 tx=0x7ff6600091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- 172.21.15.33:0/456116771 shutdown_connections 2024-08-15T17:57:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/456116771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff6640ad7c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/456116771 >> v2:172.21.15.33:3300/0 conn(0x7ff66406df10 0x7ff66406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- 172.21.15.33:0/456116771 >> 172.21.15.33:0/456116771 conn(0x7ff6640678d0 msgr2=0x7ff664067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- 172.21.15.33:0/456116771 shutdown_connections 2024-08-15T17:57:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.547+0000 7ff66a8f3700 1 -- 172.21.15.33:0/456116771 wait complete. 2024-08-15T17:57:13.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 Processor -- start 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 -- start start 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 0x7ff66414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff66414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff664155d20 0x7ff6641463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66414fc20 con 0x7ff66406df10 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66414f980 con 0x7ff6640b0350 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66415a410 con 0x7ff664155d20 2024-08-15T17:57:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 0x7ff66414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 0x7ff66414d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59656/0 (socket says 172.21.15.33:59656) 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 -- 172.21.15.33:0/4197058934 learned_addr learned my addr 172.21.15.33:0/4197058934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6690f0700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff66414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a0f2700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff664155d20 0x7ff6641463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 -- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff664155d20 msgr2=0x7ff6641463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff664155d20 0x7ff6641463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 -- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 msgr2=0x7ff66414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff66414f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 -- 172.21.15.33:0/4197058934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660009420 con 0x7ff66406df10 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6690f0700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff66414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff6698f1700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 0x7ff66414d040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff6540011e0 tx=0x7ff654007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654005b30 con 0x7ff66406df10 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654005c90 con 0x7ff66406df10 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66415a6f0 con 0x7ff66406df10 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654007320 con 0x7ff66406df10 2024-08-15T17:57:13.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.551+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66415acb0 con 0x7ff66406df10 2024-08-15T17:57:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.555+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6640643a0 con 0x7ff66406df10 2024-08-15T17:57:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.555+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff654007690 con 0x7ff66406df10 2024-08-15T17:57:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.555+0000 7ff659ffb700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff650060860 0x7ff650062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.555+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff65407beb0 con 0x7ff66406df10 2024-08-15T17:57:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.555+0000 7ff6690f0700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff650060860 0x7ff650062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.555+0000 7ff6690f0700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff650060860 0x7ff650062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff66406fb30 tx=0x7ff660017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:13.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.563+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff65404c500 con 0x7ff66406df10 2024-08-15T17:57:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.731+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff66406f5f0 con 0x7ff66406df10 2024-08-15T17:57:13.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.731+0000 7ff659ffb700 1 -- 172.21.15.33:0/4197058934 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12397 (secure 0 0 0) 0x7ff654017090 con 0x7ff66406df10 2024-08-15T17:57:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:13.735 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":45,"fsid":"55bddac8-0f58-4a43-a3ea-a8daa20f3e0c","created":"2024-08-15T17:53:25.906724+0000","modified":"2024-08-15T17:57:10.405372+0000","last_up_change":"2024-08-15T17:53:36.800457+0000","last_in_change":"2024-08-15T17:53:27.952194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-15T17:53:36.292795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bf75f1a8-294e-48b8-b111-46fa1bedfa03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":24180},{"type":"v1","addr":"172.21.15.33:6802","nonce":24180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":24180},{"type":"v1","addr":"172.21.15.33:6806","nonce":24180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":24180},{"type":"v1","addr":"172.21.15.33:6814","nonce":24180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":24180},{"type":"v1","addr":"172.21.15.33:6810","nonce":24180}]},"public_addr":"172.21.15.33:6802/24180","cluster_addr":"172.21.15.33:6806/24180","heartbeat_back_addr":"172.21.15.33:6814/24180","heartbeat_front_addr":"172.21.15.33:6810/24180","state":["exists","up"]},{"osd":1,"uuid":"ff3c434a-3d6f-40ca-ae8f-23e4c4ccac46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6801","nonce":24182},{"type":"v1","addr":"172.21.15.33:6803","nonce":24182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6805","nonce":24182},{"type":"v1","addr":"172.21.15.33:6807","nonce":24182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6813","nonce":24182},{"type":"v1","addr":"172.21.15.33:6815","nonce":24182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6809","nonce":24182},{"type":"v1","addr":"172.21.15.33:6811","nonce":24182}]},"public_addr":"172.21.15.33:6803/24182","cluster_addr":"172.21.15.33:6807/24182","heartbeat_back_addr":"172.21.15.33:6815/24182","heartbeat_front_addr":"172.21.15.33:6811/24182","state":["exists","up"]},{"osd":2,"uuid":"27432364-0499-4f40-b12b-8fdffc29387b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":24191},{"type":"v1","addr":"172.21.15.33:6825","nonce":24191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":24191},{"type":"v1","addr":"172.21.15.33:6827","nonce":24191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":24191},{"type":"v1","addr":"172.21.15.33:6831","nonce":24191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":24191},{"type":"v1","addr":"172.21.15.33:6829","nonce":24191}]},"public_addr":"172.21.15.33:6825/24191","cluster_addr":"172.21.15.33:6827/24191","heartbeat_back_addr":"172.21.15.33:6831/24191","heartbeat_front_addr":"172.21.15.33:6829/24191","state":["exists","up"]},{"osd":3,"uuid":"2b25f111-4c63-4014-a5de-4174852171c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":24181},{"type":"v1","addr":"172.21.15.33:6817","nonce":24181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":24181},{"type":"v1","addr":"172.21.15.33:6819","nonce":24181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":24181},{"type":"v1","addr":"172.21.15.33:6823","nonce":24181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":24181},{"type":"v1","addr":"172.21.15.33:6821","nonce":24181}]},"public_addr":"172.21.15.33:6817/24181","cluster_addr":"172.21.15.33:6819/24181","heartbeat_back_addr":"172.21.15.33:6823/24181","heartbeat_front_addr":"172.21.15.33:6821/24181","state":["exists","up"]},{"osd":4,"uuid":"43e1c5bc-7a3b-4de9-a4bd-0b3290a1e25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":24428},{"type":"v1","addr":"172.21.15.105:6825","nonce":24428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":24428},{"type":"v1","addr":"172.21.15.105:6827","nonce":24428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":24428},{"type":"v1","addr":"172.21.15.105:6831","nonce":24428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":24428},{"type":"v1","addr":"172.21.15.105:6829","nonce":24428}]},"public_addr":"172.21.15.105:6825/24428","cluster_addr":"172.21.15.105:6827/24428","heartbeat_back_addr":"172.21.15.105:6831/24428","heartbeat_front_addr":"172.21.15.105:6829/24428","state":["exists","up"]},{"osd":5,"uuid":"9a3a64f5-65b3-4388-b7de-f89a4ad2610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":24429},{"type":"v1","addr":"172.21.15.105:6801","nonce":24429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":24429},{"type":"v1","addr":"172.21.15.105:6803","nonce":24429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":24429},{"type":"v1","addr":"172.21.15.105:6807","nonce":24429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":24429},{"type":"v1","addr":"172.21.15.105:6805","nonce":24429}]},"public_addr":"172.21.15.105:6801/24429","cluster_addr":"172.21.15.105:6803/24429","heartbeat_back_addr":"172.21.15.105:6807/24429","heartbeat_front_addr":"172.21.15.105:6805/24429","state":["exists","up"]},{"osd":6,"uuid":"52b6fc89-f7e7-4bea-a2a6-7b0472016f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":24430},{"type":"v1","addr":"172.21.15.105:6817","nonce":24430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":24430},{"type":"v1","addr":"172.21.15.105:6819","nonce":24430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":24430},{"type":"v1","addr":"172.21.15.105:6823","nonce":24430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":24430},{"type":"v1","addr":"172.21.15.105:6821","nonce":24430}]},"public_addr":"172.21.15.105:6817/24430","cluster_addr":"172.21.15.105:6819/24430","heartbeat_back_addr":"172.21.15.105:6823/24430","heartbeat_front_addr":"172.21.15.105:6821/24430","state":["exists","up"]},{"osd":7,"uuid":"3a475085-d6a2-43b0-a2b5-cf1aaf434eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":24464},{"type":"v1","addr":"172.21.15.105:6809","nonce":24464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":24464},{"type":"v1","addr":"172.21.15.105:6811","nonce":24464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":24464},{"type":"v1","addr":"172.21.15.105:6815","nonce":24464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":24464},{"type":"v1","addr":"172.21.15.105:6813","nonce":24464}]},"public_addr":"172.21.15.105:6809/24464","cluster_addr":"172.21.15.105:6811/24464","heartbeat_back_addr":"172.21.15.105:6815/24464","heartbeat_front_addr":"172.21.15.105:6813/24464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.286345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.210280+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.399714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.422823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.374802+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:32.880053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.195290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-15T17:53:33.200576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6836/2560726379":"2024-08-16T17:57:07.394790+0000","172.21.15.105:6834/2560726379":"2024-08-16T17:57:07.394790+0000","172.21.15.105:6837/2964556950":"2024-08-16T17:57:01.104153+0000","172.21.15.105:6835/2964556950":"2024-08-16T17:57:01.104153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-15T17:57:13.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff650060860 msgr2=0x7ff650062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff650060860 0x7ff650062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff66406fb30 tx=0x7ff660017000 comp rx=0 tx=0).stop 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 msgr2=0x7ff66414d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 0x7ff66414d040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff6540011e0 tx=0x7ff654007df0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 shutdown_connections 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff650060860 0x7ff650062d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6640b0350 0x7ff66414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff664155d20 0x7ff6641463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 --2- 172.21.15.33:0/4197058934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff66406df10 0x7ff66414d040 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 >> 172.21.15.33:0/4197058934 conn(0x7ff6640678d0 msgr2=0x7ff6640ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 shutdown_connections 2024-08-15T17:57:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:13.735+0000 7ff66a8f3700 1 -- 172.21.15.33:0/4197058934 wait complete. 2024-08-15T17:57:14.750 INFO:tasks.ceph:Scrubbing osd.0 2024-08-15T17:57:14.750 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:14.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 Processor -- start 2024-08-15T17:57:14.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 -- start start 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6e5c142960 0x7f6e5c0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0aeb20 con 0x7f6e5c068ce0 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b17b0 con 0x7f6e5c142960 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e61fb0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0694b0 con 0x7f6e5c0b1330 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e617af700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6e5c068ce0 0x7f6e5c0b2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51570/0 (socket says 172.21.15.33:51570) 2024-08-15T17:57:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e617af700 1 -- 172.21.15.33:0/3240425435 learned_addr learned my addr 172.21.15.33:0/3240425435 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:14.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e60fae700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6e5c142960 0x7f6e5c0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.875+0000 7f6e5bfff700 1 --2- 172.21.15.33:0/3240425435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e5b7fe700 1 -- 172.21.15.33:0/3240425435 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976449262 0 0) 0x7f6e5c0aeb20 con 0x7f6e5c068ce0 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e5b7fe700 1 -- 172.21.15.33:0/3240425435 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e44003570 con 0x7f6e5c068ce0 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e60fae700 1 -- 172.21.15.33:0/3240425435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 msgr2=0x7f6e5c0687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e60fae700 1 --2- 172.21.15.33:0/3240425435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e60fae700 1 -- 172.21.15.33:0/3240425435 >> v1:172.21.15.33:6789/0 conn(0x7f6e5c068ce0 legacy=0x7f6e5c0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e5b7fe700 1 -- 172.21.15.33:0/3240425435 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844180089 0 0) 0x7f6e44003570 con 0x7f6e5c068ce0 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e60fae700 1 -- 172.21.15.33:0/3240425435 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c069790 con 0x7f6e5c142960 2024-08-15T17:57:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e60fae700 1 --2- 172.21.15.33:0/3240425435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c142960 0x7f6e5c0b0df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6e500098e0 tx=0x7f6e500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0453b1d014a5d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e5b7fe700 1 -- 172.21.15.33:0/3240425435 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540017f0 con 0x7f6e5c142960 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e5b7fe700 1 -- 172.21.15.33:0/3240425435 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50011420 con 0x7f6e5c142960 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e5b7fe700 1 -- 172.21.15.33:0/3240425435 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500117c0 con 0x7f6e5c142960 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3240425435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c142960 msgr2=0x7f6e5c0b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 --2- 172.21.15.33:0/3240425435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c142960 0x7f6e5c0b0df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6e500098e0 tx=0x7f6e500091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3240425435 shutdown_connections 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 --2- 172.21.15.33:0/3240425435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 --2- 172.21.15.33:0/3240425435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c142960 0x7f6e5c0b0df0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3240425435 >> 172.21.15.33:0/3240425435 conn(0x7f6e5c06cd20 msgr2=0x7f6e5c06d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3240425435 shutdown_connections 2024-08-15T17:57:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.879+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3240425435 wait complete. 2024-08-15T17:57:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 Processor -- start 2024-08-15T17:57:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 -- start start 2024-08-15T17:57:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c068ce0 0x7f6e5c16a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c142960 0x7f6e5c13fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0c8dd0 con 0x7f6e5c068ce0 2024-08-15T17:57:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0cb9d0 con 0x7f6e5c142960 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e61fb0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c140150 con 0x7f6e5c0b1330 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c068ce0 0x7f6e5c16a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c068ce0 0x7f6e5c16a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59680/0 (socket says 172.21.15.33:59680) 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 -- 172.21.15.33:0/3281517947 learned_addr learned my addr 172.21.15.33:0/3281517947 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e5bfff700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e617af700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c142960 0x7f6e5c13fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 -- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 msgr2=0x7f6e5c0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5c0b1330 0x7f6e5c0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 -- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c142960 msgr2=0x7f6e5c13fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e5c142960 0x7f6e5c13fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.883+0000 7f6e60fae700 1 -- 172.21.15.33:0/3281517947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50009420 con 0x7f6e5c068ce0 2024-08-15T17:57:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e60fae700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c068ce0 0x7f6e5c16a3d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c068460 tx=0x7f6e50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5001caf0 con 0x7f6e5c068ce0 2024-08-15T17:57:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5001cc50 con 0x7f6e5c068ce0 2024-08-15T17:57:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c1403f0 con 0x7f6e5c068ce0 2024-08-15T17:57:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5001a6a0 con 0x7f6e5c068ce0 2024-08-15T17:57:14.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c1409b0 con 0x7f6e5c068ce0 2024-08-15T17:57:14.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e5c140d50 con 0x7f6e5c068ce0 2024-08-15T17:57:14.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6e5001aad0 con 0x7f6e5c068ce0 2024-08-15T17:57:14.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6e48060860 0x7f6e48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6e5007e870 con 0x7f6e5c068ce0 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7f6e48066750 0x7f6e48068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 --> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e48069210 con 0x7f6e48066750 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e5007ec40 con 0x7f6e5c068ce0 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.887+0000 7f6e5bfff700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6e48060860 0x7f6e48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.891+0000 7f6e617af700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7f6e48066750 0x7f6e48068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:14.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.891+0000 7f6e617af700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7f6e48066750 0x7f6e48068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:14.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.891+0000 7f6e5bfff700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6e48060860 0x7f6e48062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c06c550 tx=0x7f6e4c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:14.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.891+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== osd.0 v2:172.21.15.33:6800/24180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6e48069210 con 0x7f6e48066750 2024-08-15T17:57:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.903+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 --> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6e5c0ae710 con 0x7f6e48066750 2024-08-15T17:57:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.903+0000 7f6e58ff9700 1 -- 172.21.15.33:0/3281517947 <== osd.0 v2:172.21.15.33:6800/24180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6e5c0ae710 con 0x7f6e48066750 2024-08-15T17:57:14.907 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:14.907 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:14.907 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7f6e48066750 msgr2=0x7f6e48068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:6800/24180,v1:172.21.15.33:6802/24180] conn(0x7f6e48066750 0x7f6e48068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6e48060860 msgr2=0x7f6e48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f6e48060860 0x7f6e48062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c06c550 tx=0x7f6e4c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c068ce0 msgr2=0x7f6e5c16a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 --2- 172.21.15.33:0/3281517947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e5c068ce0 0x7f6e5c16a3d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c068460 tx=0x7f6e50016000 comp rx=0 tx=0).stop 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e617af700 1 -- 172.21.15.33:0/3281517947 reap_dead start 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 shutdown_connections 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 >> 172.21.15.33:0/3281517947 conn(0x7f6e5c06cd20 msgr2=0x7f6e5c13cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 shutdown_connections 2024-08-15T17:57:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:14.907+0000 7f6e61fb0700 1 -- 172.21.15.33:0/3281517947 wait complete. 2024-08-15T17:57:14.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-15T17:57:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.027+0000 7f8956d76700 1 Processor -- start 2024-08-15T17:57:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.027+0000 7f8956d76700 1 -- start start 2024-08-15T17:57:15.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8950155d80 0x7f89500aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89500af420 0x7f89500acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500af850 con 0x7f89500ad090 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500ad8a0 con 0x7f8950155d80 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89500adb80 con 0x7f89500af420 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956575700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f89500ad090 0x7f89501599d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51574/0 (socket says 172.21.15.33:51574) 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956575700 1 -- 172.21.15.33:0/3892681138 learned_addr learned my addr 172.21.15.33:0/3892681138 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955573700 1 --2- 172.21.15.33:0/3892681138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89500af420 0x7f89500acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955d74700 1 --2- 172.21.15.33:0/3892681138 >> v2:172.21.15.105:3300/0 conn(0x7f8950155d80 0x7f89500aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8954d72700 1 -- 172.21.15.33:0/3892681138 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954801229 0 0) 0x7f89500af850 con 0x7f89500ad090 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8954d72700 1 -- 172.21.15.33:0/3892681138 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f893c003570 con 0x7f89500ad090 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955573700 1 -- 172.21.15.33:0/3892681138 >> v2:172.21.15.105:3300/0 conn(0x7f8950155d80 msgr2=0x7f89500aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955573700 1 --2- 172.21.15.33:0/3892681138 >> v2:172.21.15.105:3300/0 conn(0x7f8950155d80 0x7f89500aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955573700 1 -- 172.21.15.33:0/3892681138 >> v1:172.21.15.33:6789/0 conn(0x7f89500ad090 legacy=0x7f89501599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955573700 1 -- 172.21.15.33:0/3892681138 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500ade60 con 0x7f89500af420 2024-08-15T17:57:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8955573700 1 --2- 172.21.15.33:0/3892681138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89500af420 0x7f89500acb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f894c009910 tx=0x7f894c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d4ff0dc6185597 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8954d72700 1 -- 172.21.15.33:0/3892681138 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011630 con 0x7f89500af420 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8954d72700 1 -- 172.21.15.33:0/3892681138 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c011790 con 0x7f89500af420 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8954d72700 1 -- 172.21.15.33:0/3892681138 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011b30 con 0x7f89500af420 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- 172.21.15.33:0/3892681138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89500af420 msgr2=0x7f89500acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 --2- 172.21.15.33:0/3892681138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89500af420 0x7f89500acb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f894c009910 tx=0x7f894c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- 172.21.15.33:0/3892681138 shutdown_connections 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 --2- 172.21.15.33:0/3892681138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89500af420 0x7f89500acb50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 --2- 172.21.15.33:0/3892681138 >> v2:172.21.15.105:3300/0 conn(0x7f8950155d80 0x7f89500aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- 172.21.15.33:0/3892681138 >> 172.21.15.33:0/3892681138 conn(0x7f895006e070 msgr2=0x7f89500b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- 172.21.15.33:0/3892681138 shutdown_connections 2024-08-15T17:57:15.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.031+0000 7f8956d76700 1 -- 172.21.15.33:0/3892681138 wait complete. 2024-08-15T17:57:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 Processor -- start 2024-08-15T17:57:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 -- start start 2024-08-15T17:57:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 0x7f89501428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89500af420 0x7f8950142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8950155d80 0x7f8950169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950143370 con 0x7f89500ad090 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895014be80 con 0x7f89500af420 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956d76700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895014b5b0 con 0x7f8950155d80 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 0x7f89501428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 0x7f89501428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59684/0 (socket says 172.21.15.33:59684) 2024-08-15T17:57:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 -- 172.21.15.33:0/2511181610 learned_addr learned my addr 172.21.15.33:0/2511181610 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955573700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89500af420 0x7f8950142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956575700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8950155d80 0x7f8950169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 -- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8950155d80 msgr2=0x7f8950169360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8950155d80 0x7f8950169360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 -- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89500af420 msgr2=0x7f8950142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89500af420 0x7f8950142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 -- 172.21.15.33:0/2511181610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c009420 con 0x7f89500ad090 2024-08-15T17:57:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955573700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89500af420 0x7f8950142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8956575700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8950155d80 0x7f8950169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.035+0000 7f8955d74700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 0x7f89501428f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f894400e960 tx=0x7f89440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944009510 con 0x7f89500ad090 2024-08-15T17:57:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894400c850 con 0x7f89500ad090 2024-08-15T17:57:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895014c310 con 0x7f89500ad090 2024-08-15T17:57:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400cc10 con 0x7f89500ad090 2024-08-15T17:57:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895014b830 con 0x7f89500ad090 2024-08-15T17:57:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89500638f0 con 0x7f89500ad090 2024-08-15T17:57:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8944013470 con 0x7f89500ad090 2024-08-15T17:57:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8941ffb700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8934060860 0x7f8934062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f894407ca40 con 0x7f89500ad090 2024-08-15T17:57:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.039+0000 7f8955573700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8934060860 0x7f8934062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.043+0000 7f8955573700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8934060860 0x7f8934062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f894c0091e0 tx=0x7f894c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.047+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f894407ee60 con 0x7f89500ad090 2024-08-15T17:57:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.211+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f89500aeaf0 con 0x7f8934060860 2024-08-15T17:57:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8941ffb700 1 -- 172.21.15.33:0/2511181610 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f89500aeaf0 con 0x7f8934060860 2024-08-15T17:57:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8934060860 msgr2=0x7f8934062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8934060860 0x7f8934062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f894c0091e0 tx=0x7f894c017000 comp rx=0 tx=0).stop 2024-08-15T17:57:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 msgr2=0x7f89501428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 0x7f89501428f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f894400e960 tx=0x7f89440091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 shutdown_connections 2024-08-15T17:57:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8934060860 0x7f8934062d10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89500af420 0x7f8950142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8950155d80 0x7f8950169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 --2- 172.21.15.33:0/2511181610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89500ad090 0x7f89501428f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 >> 172.21.15.33:0/2511181610 conn(0x7f895006e070 msgr2=0x7f89500c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 shutdown_connections 2024-08-15T17:57:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.215+0000 7f8956d76700 1 -- 172.21.15.33:0/2511181610 wait complete. 2024-08-15T17:57:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 0 to deep-scrub 2024-08-15T17:57:15.229 INFO:tasks.ceph:Scrubbing osd.1 2024-08-15T17:57:15.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:15.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 Processor -- start 2024-08-15T17:57:15.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 -- start start 2024-08-15T17:57:15.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4380b26d0 0x7fe4380b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe4380cded0 0x7fe4380ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4380c5b40 con 0x7fe4380c5fd0 2024-08-15T17:57:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380b2aa0 con 0x7fe4380cded0 2024-08-15T17:57:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.343+0000 7fe43ec1b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe438159820 con 0x7fe4380b26d0 2024-08-15T17:57:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43e41a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe4380cded0 0x7fe4380ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43d418700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe4380c5fd0 0x7fe4380c6450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51576/0 (socket says 172.21.15.33:51576) 2024-08-15T17:57:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43d418700 1 -- 172.21.15.33:0/618840270 learned_addr learned my addr 172.21.15.33:0/618840270 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43dc19700 1 --2- 172.21.15.33:0/618840270 >> v2:172.21.15.105:3300/0 conn(0x7fe4380b26d0 0x7fe4380b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43cc17700 1 -- 172.21.15.33:0/618840270 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595045629 0 0) 0x7fe4380c5b40 con 0x7fe4380c5fd0 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43cc17700 1 -- 172.21.15.33:0/618840270 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe424003570 con 0x7fe4380c5fd0 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43e41a700 1 -- 172.21.15.33:0/618840270 >> v2:172.21.15.105:3300/0 conn(0x7fe4380b26d0 msgr2=0x7fe4380b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43e41a700 1 --2- 172.21.15.33:0/618840270 >> v2:172.21.15.105:3300/0 conn(0x7fe4380b26d0 0x7fe4380b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43e41a700 1 -- 172.21.15.33:0/618840270 >> v1:172.21.15.33:6789/0 conn(0x7fe4380c5fd0 legacy=0x7fe4380c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43e41a700 1 -- 172.21.15.33:0/618840270 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4380c4f30 con 0x7fe4380cded0 2024-08-15T17:57:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43e41a700 1 --2- 172.21.15.33:0/618840270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe4380ce330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe430009e60 tx=0x7fe430009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264f1c210e43af22 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43cc17700 1 -- 172.21.15.33:0/618840270 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000e070 con 0x7fe4380cded0 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43cc17700 1 -- 172.21.15.33:0/618840270 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000ba70 con 0x7fe4380cded0 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43cc17700 1 -- 172.21.15.33:0/618840270 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000be30 con 0x7fe4380cded0 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 -- 172.21.15.33:0/618840270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 msgr2=0x7fe4380ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 --2- 172.21.15.33:0/618840270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe4380ce330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe430009e60 tx=0x7fe430009780 comp rx=0 tx=0).stop 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 -- 172.21.15.33:0/618840270 shutdown_connections 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 --2- 172.21.15.33:0/618840270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe4380ce330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 --2- 172.21.15.33:0/618840270 >> v2:172.21.15.105:3300/0 conn(0x7fe4380b26d0 0x7fe4380b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 -- 172.21.15.33:0/618840270 >> 172.21.15.33:0/618840270 conn(0x7fe438067590 msgr2=0x7fe4380d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 -- 172.21.15.33:0/618840270 shutdown_connections 2024-08-15T17:57:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.347+0000 7fe43ec1b700 1 -- 172.21.15.33:0/618840270 wait complete. 2024-08-15T17:57:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 Processor -- start 2024-08-15T17:57:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 -- start start 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4380b26d0 0x7fe43809c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4380c5fd0 0x7fe43806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe438068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43816daf0 con 0x7fe4380cded0 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806eb70 con 0x7fe4380b26d0 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43816d1c0 con 0x7fe4380c5fd0 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe438068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe438068400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59706/0 (socket says 172.21.15.33:59706) 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 -- 172.21.15.33:0/3817672247 learned_addr learned my addr 172.21.15.33:0/3817672247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43d418700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4380c5fd0 0x7fe43806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43dc19700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4380b26d0 0x7fe43809c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 -- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4380c5fd0 msgr2=0x7fe43806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4380c5fd0 0x7fe43806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 -- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4380b26d0 msgr2=0x7fe43809c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4380b26d0 0x7fe43809c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 -- 172.21.15.33:0/3817672247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009a20 con 0x7fe4380cded0 2024-08-15T17:57:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43e41a700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe438068400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe4380893f0 tx=0x7fe430019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430012e50 con 0x7fe4380cded0 2024-08-15T17:57:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe430027470 con 0x7fe4380cded0 2024-08-15T17:57:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43816d4a0 con 0x7fe4380cded0 2024-08-15T17:57:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430027850 con 0x7fe4380cded0 2024-08-15T17:57:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.351+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380ca0a0 con 0x7fe4380cded0 2024-08-15T17:57:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe43809dd50 con 0x7fe4380cded0 2024-08-15T17:57:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe430024070 con 0x7fe4380cded0 2024-08-15T17:57:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe42dffb700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe41c060860 0x7fe41c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe43007ef60 con 0x7fe4380cded0 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe43dc19700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe41c060860 0x7fe41c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe42dffb700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe41c066750 0x7fe41c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 --> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe41c069210 con 0x7fe41c066750 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4300814c0 con 0x7fe4380cded0 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe43d418700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe41c066750 0x7fe41c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe43dc19700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe41c060860 0x7fe41c062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b2050 tx=0x7fe4280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.355+0000 7fe43d418700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe41c066750 0x7fe41c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.359+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== osd.1 v2:172.21.15.33:6801/24182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe41c069210 con 0x7fe41c066750 2024-08-15T17:57:15.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 --> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe4380644b0 con 0x7fe41c066750 2024-08-15T17:57:15.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe42dffb700 1 -- 172.21.15.33:0/3817672247 <== osd.1 v2:172.21.15.33:6801/24182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe4380644b0 con 0x7fe41c066750 2024-08-15T17:57:15.378 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:15.378 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:15.379 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe41c066750 msgr2=0x7fe41c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:6801/24182,v1:172.21.15.33:6803/24182] conn(0x7fe41c066750 0x7fe41c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe41c060860 msgr2=0x7fe41c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fe41c060860 0x7fe41c062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b2050 tx=0x7fe4280091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 msgr2=0x7fe438068400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 --2- 172.21.15.33:0/3817672247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4380cded0 0x7fe438068400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe4380893f0 tx=0x7fe430019000 comp rx=0 tx=0).stop 2024-08-15T17:57:15.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43e41a700 1 -- 172.21.15.33:0/3817672247 reap_dead start 2024-08-15T17:57:15.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 shutdown_connections 2024-08-15T17:57:15.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 >> 172.21.15.33:0/3817672247 conn(0x7fe438067590 msgr2=0x7fe438157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 shutdown_connections 2024-08-15T17:57:15.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.375+0000 7fe43ec1b700 1 -- 172.21.15.33:0/3817672247 wait complete. 2024-08-15T17:57:15.391 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-15T17:57:15.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 Processor -- start 2024-08-15T17:57:15.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 -- start start 2024-08-15T17:57:15.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e68153a70 0x7f0e68159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0e6806e9c0 0x7f0e68158260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e68157810 con 0x7f0e68153e40 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e68157dd0 con 0x7f0e68153a70 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6efb2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6815a700 con 0x7f0e6806e9c0 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6cd4e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e68153a70 0x7f0e68159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e67fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0e68153e40 0x7f0e6806e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51590/0 (socket says 172.21.15.33:51590) 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e67fff700 1 -- 172.21.15.33:0/1031120940 learned_addr learned my addr 172.21.15.33:0/1031120940 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6d54f700 1 --2- 172.21.15.33:0/1031120940 >> v2:172.21.15.105:3300/0 conn(0x7f0e6806e9c0 0x7f0e68158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6cd4e700 1 -- 172.21.15.33:0/1031120940 >> v2:172.21.15.105:3300/0 conn(0x7f0e6806e9c0 msgr2=0x7f0e68158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:15.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6cd4e700 1 --2- 172.21.15.33:0/1031120940 >> v2:172.21.15.105:3300/0 conn(0x7f0e6806e9c0 0x7f0e68158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6cd4e700 1 -- 172.21.15.33:0/1031120940 >> v1:172.21.15.33:6789/0 conn(0x7f0e68153e40 legacy=0x7f0e6806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.503+0000 7f0e6cd4e700 1 -- 172.21.15.33:0/1031120940 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6815a9e0 con 0x7f0e68153a70 2024-08-15T17:57:15.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6cd4e700 1 --2- 172.21.15.33:0/1031120940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68159c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0e68157d40 tx=0x7f0e500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b415ebab4602533 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e677fe700 1 -- 172.21.15.33:0/1031120940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50011630 con 0x7f0e68153a70 2024-08-15T17:57:15.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e677fe700 1 -- 172.21.15.33:0/1031120940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50011790 con 0x7f0e68153a70 2024-08-15T17:57:15.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e677fe700 1 -- 172.21.15.33:0/1031120940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50011b30 con 0x7f0e68153a70 2024-08-15T17:57:15.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1031120940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 msgr2=0x7f0e68159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1031120940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68159c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0e68157d40 tx=0x7f0e500091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1031120940 shutdown_connections 2024-08-15T17:57:15.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1031120940 >> v2:172.21.15.105:3300/0 conn(0x7f0e6806e9c0 0x7f0e68158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1031120940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68159c40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1031120940 >> 172.21.15.33:0/1031120940 conn(0x7f0e68067810 msgr2=0x7f0e68067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1031120940 shutdown_connections 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1031120940 wait complete. 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 Processor -- start 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- start start 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6806e9c0 0x7f0e680979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e68153e40 0x7f0e68165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680b1330 con 0x7f0e68153a70 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68097f00 con 0x7f0e68153e40 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6efb2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680b06b0 con 0x7f0e6806e9c0 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59714/0 (socket says 172.21.15.33:59714) 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e67fff700 1 -- 172.21.15.33:0/1244541688 learned_addr learned my addr 172.21.15.33:0/1244541688 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:15.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6cd4e700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6806e9c0 0x7f0e680979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.507+0000 7f0e6d54f700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e68153e40 0x7f0e68165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e67fff700 1 -- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6806e9c0 msgr2=0x7f0e680979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e67fff700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6806e9c0 0x7f0e680979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e67fff700 1 -- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e68153e40 msgr2=0x7f0e68165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e67fff700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e68153e40 0x7f0e68165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e67fff700 1 -- 172.21.15.33:0/1244541688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009420 con 0x7f0e68153a70 2024-08-15T17:57:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e6cd4e700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6806e9c0 0x7f0e680979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e6d54f700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e68153e40 0x7f0e68165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e67fff700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68165340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c790 tx=0x7f0e58007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58005b30 con 0x7f0e68153a70 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58005cb0 con 0x7f0e68153a70 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e680b0990 con 0x7f0e68153a70 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58004a80 con 0x7f0e68153a70 2024-08-15T17:57:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e680b0f50 con 0x7f0e68153a70 2024-08-15T17:57:15.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e680b1470 con 0x7f0e68153a70 2024-08-15T17:57:15.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0e58005030 con 0x7f0e68153a70 2024-08-15T17:57:15.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e64ff9700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e48060860 0x7f0e48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0e5807c2a0 con 0x7f0e68153a70 2024-08-15T17:57:15.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.511+0000 7f0e6cd4e700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e48060860 0x7f0e48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.515+0000 7f0e6cd4e700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e48060860 0x7f0e48062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e50003080 tx=0x7f0e50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.523+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0e680b1470 con 0x7f0e68153a70 2024-08-15T17:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.687+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e680b1470 con 0x7f0e48060860 2024-08-15T17:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.687+0000 7f0e64ff9700 1 -- 172.21.15.33:0/1244541688 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e680b1470 con 0x7f0e48060860 2024-08-15T17:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e48060860 msgr2=0x7f0e48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e48060860 0x7f0e48062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e50003080 tx=0x7f0e50017000 comp rx=0 tx=0).stop 2024-08-15T17:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 msgr2=0x7f0e68165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68165340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c790 tx=0x7f0e58007f40 comp rx=0 tx=0).stop 2024-08-15T17:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 shutdown_connections 2024-08-15T17:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f0e48060860 0x7f0e48062d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e68153e40 0x7f0e68165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e68153a70 0x7f0e68165340 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 --2- 172.21.15.33:0/1244541688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e6806e9c0 0x7f0e680979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 >> 172.21.15.33:0/1244541688 conn(0x7f0e68067810 msgr2=0x7f0e6814f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 shutdown_connections 2024-08-15T17:57:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.691+0000 7f0e6efb2700 1 -- 172.21.15.33:0/1244541688 wait complete. 2024-08-15T17:57:15.694 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 1 to deep-scrub 2024-08-15T17:57:15.703 INFO:tasks.ceph:Scrubbing osd.2 2024-08-15T17:57:15.704 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:15.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f788354a700 1 Processor -- start 2024-08-15T17:57:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f788354a700 1 -- start start 2024-08-15T17:57:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f788354a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c0ac0a0 0x7f787c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f788354a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c1564d0 con 0x7f787c155c80 2024-08-15T17:57:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f788354a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c069020 con 0x7f787c068be0 2024-08-15T17:57:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f788354a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0ac6a0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7882548700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f787c155c80 0x7f787c06e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51596/0 (socket says 172.21.15.33:51596) 2024-08-15T17:57:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7882548700 1 -- 172.21.15.33:0/1785898831 learned_addr learned my addr 172.21.15.33:0/1785898831 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881d47700 1 --2- 172.21.15.33:0/1785898831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c0ac0a0 0x7f787c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881d47700 1 -- 172.21.15.33:0/1785898831 >> v1:172.21.15.105:6789/0 conn(0x7f787c068be0 legacy=0x7f787c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881546700 1 -- 172.21.15.33:0/1785898831 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620798410 0 0) 0x7f787c1564d0 con 0x7f787c155c80 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881d47700 1 -- 172.21.15.33:0/1785898831 >> v1:172.21.15.33:6789/0 conn(0x7f787c155c80 legacy=0x7f787c06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881d47700 1 -- 172.21.15.33:0/1785898831 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0ac980 con 0x7f787c0ac0a0 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881d47700 1 --2- 172.21.15.33:0/1785898831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c0ac0a0 0x7f787c0686a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f786c009890 tx=0x7f786c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f66dda9172ae5e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881546700 1 -- 172.21.15.33:0/1785898831 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c011630 con 0x7f787c0ac0a0 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881546700 1 -- 172.21.15.33:0/1785898831 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c011790 con 0x7f787c0ac0a0 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.819+0000 7f7881546700 1 -- 172.21.15.33:0/1785898831 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c011b50 con 0x7f787c0ac0a0 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/1785898831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c0ac0a0 msgr2=0x7f787c0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 --2- 172.21.15.33:0/1785898831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c0ac0a0 0x7f787c0686a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f786c009890 tx=0x7f786c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/1785898831 shutdown_connections 2024-08-15T17:57:15.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 --2- 172.21.15.33:0/1785898831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c0ac0a0 0x7f787c0686a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/1785898831 >> 172.21.15.33:0/1785898831 conn(0x7f787c0ccfe0 msgr2=0x7f787c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/1785898831 shutdown_connections 2024-08-15T17:57:15.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/1785898831 wait complete. 2024-08-15T17:57:15.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 Processor -- start 2024-08-15T17:57:15.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- start start 2024-08-15T17:57:15.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c068be0 0x7f787c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c0ac0a0 0x7f787c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f787c155c80 0x7f787c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c1458c0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c1519e0 con 0x7f787c155c80 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c151cc0 con 0x7f787c068be0 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c0ac0a0 0x7f787c0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c0ac0a0 0x7f787c0c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59716/0 (socket says 172.21.15.33:59716) 2024-08-15T17:57:15.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 -- 172.21.15.33:0/2253644444 learned_addr learned my addr 172.21.15.33:0/2253644444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7882548700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c068be0 0x7f787c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7882d49700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f787c155c80 0x7f787c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 -- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c068be0 msgr2=0x7f787c0cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c068be0 0x7f787c0cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 -- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f787c155c80 msgr2=0x7f787c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f787c155c80 0x7f787c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 -- 172.21.15.33:0/2253644444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c009420 con 0x7f787c0ac0a0 2024-08-15T17:57:15.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7882548700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f787c068be0 0x7f787c0cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7882d49700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f787c155c80 0x7f787c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f7881d47700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c0ac0a0 0x7f787c0c14c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f786c002000 tx=0x7f786c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01a450 con 0x7f787c0ac0a0 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c151fa0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c152560 con 0x7f787c0ac0a0 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c01a7c0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.823+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01a930 con 0x7f787c0ac0a0 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7864000fd0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f786c00b420 con 0x7f787c0ac0a0 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f78727fc700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7860060860 0x7f7860062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f786c07efe0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f7882548700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7860060860 0x7f7860062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f78727fc700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f7860066750 0x7f7860068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 --> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7860069210 con 0x7f7860066750 2024-08-15T17:57:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f786c07f2f0 con 0x7f787c0ac0a0 2024-08-15T17:57:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f7882d49700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f7860066750 0x7f7860068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f7882d49700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f7860066750 0x7f7860068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.827+0000 7f7882548700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7860060860 0x7f7860062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7878000c00 tx=0x7f7878009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.831+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== osd.2 v2:172.21.15.33:6824/24191 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7860069210 con 0x7f7860066750 2024-08-15T17:57:15.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.847+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 --> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7864002d50 con 0x7f7860066750 2024-08-15T17:57:15.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.847+0000 7f78727fc700 1 -- 172.21.15.33:0/2253644444 <== osd.2 v2:172.21.15.33:6824/24191 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7864002d50 con 0x7f7860066750 2024-08-15T17:57:15.851 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:15.851 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:15.852 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:15.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.847+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f7860066750 msgr2=0x7f7860068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.847+0000 7f788354a700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:6824/24191,v1:172.21.15.33:6825/24191] conn(0x7f7860066750 0x7f7860068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7860060860 msgr2=0x7f7860062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7860060860 0x7f7860062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7878000c00 tx=0x7f7878009040 comp rx=0 tx=0).stop 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c0ac0a0 msgr2=0x7f787c0c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 --2- 172.21.15.33:0/2253644444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c0ac0a0 0x7f787c0c14c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f786c002000 tx=0x7f786c016000 comp rx=0 tx=0).stop 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f7882d49700 1 -- 172.21.15.33:0/2253644444 reap_dead start 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 shutdown_connections 2024-08-15T17:57:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 >> 172.21.15.33:0/2253644444 conn(0x7f787c0ccfe0 msgr2=0x7f787c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 shutdown_connections 2024-08-15T17:57:15.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.851+0000 7f788354a700 1 -- 172.21.15.33:0/2253644444 wait complete. 2024-08-15T17:57:15.863 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-15T17:57:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.971+0000 7f80ace8f700 1 Processor -- start 2024-08-15T17:57:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.971+0000 7f80ace8f700 1 -- start start 2024-08-15T17:57:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.971+0000 7f80ace8f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80a8156d80 0x7f80a80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80a8067f50 0x7f80a8157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80cc8c0 con 0x7f80a80af170 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a80af5f0 con 0x7f80a8156d80 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a80cbca0 con 0x7f80a8067f50 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a6ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f80a80af170 0x7f80a8067840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51602/0 (socket says 172.21.15.33:51602) 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80a8156d80 0x7f80a80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a6ffd700 1 -- 172.21.15.33:0/2842806757 learned_addr learned my addr 172.21.15.33:0/2842806757 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a7fff700 1 --2- 172.21.15.33:0/2842806757 >> v2:172.21.15.105:3300/0 conn(0x7f80a8067f50 0x7f80a8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a67fc700 1 -- 172.21.15.33:0/2842806757 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438590310 0 0) 0x7f80a80cc8c0 con 0x7f80a80af170 2024-08-15T17:57:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a67fc700 1 -- 172.21.15.33:0/2842806757 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8090003570 con 0x7f80a80af170 2024-08-15T17:57:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a7fff700 1 -- 172.21.15.33:0/2842806757 >> v2:172.21.15.33:3300/0 conn(0x7f80a8156d80 msgr2=0x7f80a80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a7fff700 1 --2- 172.21.15.33:0/2842806757 >> v2:172.21.15.33:3300/0 conn(0x7f80a8156d80 0x7f80a80aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a7fff700 1 -- 172.21.15.33:0/2842806757 >> v1:172.21.15.33:6789/0 conn(0x7f80a80af170 legacy=0x7f80a8067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a67fc700 1 -- 172.21.15.33:0/2842806757 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594467598 0 0) 0x7f8090003570 con 0x7f80a80af170 2024-08-15T17:57:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a7fff700 1 -- 172.21.15.33:0/2842806757 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8068450 con 0x7f80a8067f50 2024-08-15T17:57:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a7fff700 1 --2- 172.21.15.33:0/2842806757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8067f50 0x7f80a8157150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80a80c95d0 tx=0x7f80a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23a80ebdce1fe326 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a67fc700 1 -- 172.21.15.33:0/2842806757 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000e070 con 0x7f80a8067f50 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a67fc700 1 -- 172.21.15.33:0/2842806757 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000b7a0 con 0x7f80a8067f50 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80a67fc700 1 -- 172.21.15.33:0/2842806757 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c001470 con 0x7f80a8067f50 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- 172.21.15.33:0/2842806757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8067f50 msgr2=0x7f80a8157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 --2- 172.21.15.33:0/2842806757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8067f50 0x7f80a8157150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80a80c95d0 tx=0x7f80a0009780 comp rx=0 tx=0).stop 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- 172.21.15.33:0/2842806757 shutdown_connections 2024-08-15T17:57:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 --2- 172.21.15.33:0/2842806757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8067f50 0x7f80a8157150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 --2- 172.21.15.33:0/2842806757 >> v2:172.21.15.33:3300/0 conn(0x7f80a8156d80 0x7f80a80aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- 172.21.15.33:0/2842806757 >> 172.21.15.33:0/2842806757 conn(0x7f80a806e070 msgr2=0x7f80a80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- 172.21.15.33:0/2842806757 shutdown_connections 2024-08-15T17:57:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.975+0000 7f80ace8f700 1 -- 172.21.15.33:0/2842806757 wait complete. 2024-08-15T17:57:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.979+0000 7f80ace8f700 1 Processor -- start 2024-08-15T17:57:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.979+0000 7f80ace8f700 1 -- start start 2024-08-15T17:57:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8067f50 0x7f80a814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 0x7f80a8167280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8156d80 0x7f80a80b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8159020 con 0x7f80a80af170 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8158130 con 0x7f80a8156d80 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8158410 con 0x7f80a8067f50 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 0x7f80a8167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 0x7f80a8167280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59732/0 (socket says 172.21.15.33:59732) 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 -- 172.21.15.33:0/927775852 learned_addr learned my addr 172.21.15.33:0/927775852 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a7fff700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8156d80 0x7f80a80b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a77fe700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8067f50 0x7f80a814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 -- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8067f50 msgr2=0x7f80a814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8067f50 0x7f80a814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 -- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8156d80 msgr2=0x7f80a80b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8156d80 0x7f80a80b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 -- 172.21.15.33:0/927775852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0009a20 con 0x7f80a80af170 2024-08-15T17:57:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80a6ffd700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 0x7f80a8167280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f809c00cb90 tx=0x7f809c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00cea0 con 0x7f80a80af170 2024-08-15T17:57:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c007e90 con 0x7f80a80af170 2024-08-15T17:57:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a81586f0 con 0x7f80a80af170 2024-08-15T17:57:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c007590 con 0x7f80a80af170 2024-08-15T17:57:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.983+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a8158cb0 con 0x7f80a80af170 2024-08-15T17:57:15.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.987+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f809c004a40 con 0x7f80a80af170 2024-08-15T17:57:15.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.987+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a81591d0 con 0x7f80a80af170 2024-08-15T17:57:15.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.987+0000 7f808f7fe700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8094060890 0x7f8094062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:15.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.987+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f809c07c030 con 0x7f80a80af170 2024-08-15T17:57:15.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.987+0000 7f80a77fe700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8094060890 0x7f8094062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:15.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.987+0000 7f80a77fe700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8094060890 0x7f8094062d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8098009db0 tx=0x7f80980091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:15.995+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f80a81591d0 con 0x7f80a80af170 2024-08-15T17:57:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.155+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f80a80638f0 con 0x7f8094060890 2024-08-15T17:57:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.155+0000 7f808f7fe700 1 -- 172.21.15.33:0/927775852 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80a80638f0 con 0x7f8094060890 2024-08-15T17:57:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8094060890 msgr2=0x7f8094062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8094060890 0x7f8094062d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8098009db0 tx=0x7f80980091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 msgr2=0x7f80a8167280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 0x7f80a8167280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f809c00cb90 tx=0x7f809c001b50 comp rx=0 tx=0).stop 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 shutdown_connections 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8094060890 0x7f8094062d40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8156d80 0x7f80a80b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a80af170 0x7f80a8167280 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 --2- 172.21.15.33:0/927775852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8067f50 0x7f80a814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 >> 172.21.15.33:0/927775852 conn(0x7f80a806e070 msgr2=0x7f80a8152030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 shutdown_connections 2024-08-15T17:57:16.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.159+0000 7f80ace8f700 1 -- 172.21.15.33:0/927775852 wait complete. 2024-08-15T17:57:16.163 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 2 to deep-scrub 2024-08-15T17:57:16.177 INFO:tasks.ceph:Scrubbing osd.3 2024-08-15T17:57:16.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:16.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.291+0000 7fce64951700 1 Processor -- start 2024-08-15T17:57:16.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.291+0000 7fce64951700 1 -- start start 2024-08-15T17:57:16.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce64951700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce6006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce64951700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fce60155760 0x7fce600ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce64951700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 0x7fce60068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce64951700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600af170 con 0x7fce600686a0 2024-08-15T17:57:16.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce64951700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce60069060 con 0x7fce60155760 2024-08-15T17:57:16.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce64951700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600abd70 con 0x7fce60155390 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5f59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 0x7fce60068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5f59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 0x7fce60068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59746/0 (socket says 172.21.15.33:59746) 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5f59e700 1 -- 172.21.15.33:0/1820634341 learned_addr learned my addr 172.21.15.33:0/1820634341 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 --2- 172.21.15.33:0/1820634341 >> v2:172.21.15.105:3300/0 conn(0x7fce60155760 0x7fce600ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5ed9d700 1 --2- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce6006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 -- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 msgr2=0x7fce6006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 --2- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce6006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 -- 172.21.15.33:0/1820634341 >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 msgr2=0x7fce60068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:16.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 --2- 172.21.15.33:0/1820634341 >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 0x7fce60068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 -- 172.21.15.33:0/1820634341 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600ac050 con 0x7fce60155760 2024-08-15T17:57:16.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5f59e700 1 --2- 172.21.15.33:0/1820634341 >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 0x7fce60068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-15T17:57:16.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5e59c700 1 --2- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce600ae890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce6006f130 tx=0x7fce480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b71c30ae8429 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5dd9b700 1 -- 172.21.15.33:0/1820634341 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48011630 con 0x7fce60155760 2024-08-15T17:57:16.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5dd9b700 1 -- 172.21.15.33:0/1820634341 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce480117b0 con 0x7fce60155760 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.295+0000 7fce5dd9b700 1 -- 172.21.15.33:0/1820634341 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48011b70 con 0x7fce60155760 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 -- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 msgr2=0x7fce600ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 --2- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce600ae890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce6006f130 tx=0x7fce480091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 -- 172.21.15.33:0/1820634341 shutdown_connections 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 --2- 172.21.15.33:0/1820634341 >> v2:172.21.15.33:3300/0 conn(0x7fce600686a0 0x7fce60068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 --2- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce600ae890 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 --2- 172.21.15.33:0/1820634341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce6006e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 -- 172.21.15.33:0/1820634341 >> 172.21.15.33:0/1820634341 conn(0x7fce600ccfe0 msgr2=0x7fce6006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 -- 172.21.15.33:0/1820634341 shutdown_connections 2024-08-15T17:57:16.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 -- 172.21.15.33:0/1820634341 wait complete. 2024-08-15T17:57:16.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.299+0000 7fce64951700 1 Processor -- start 2024-08-15T17:57:16.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 -- start start 2024-08-15T17:57:16.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce600686a0 0x7fce6014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce60069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce6016add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60167850 con 0x7fce600686a0 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce600686a0 0x7fce6014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600ab500 con 0x7fce60155760 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce64951700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6014af30 con 0x7fce60155390 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce600686a0 0x7fce6014d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59760/0 (socket says 172.21.15.33:59760) 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 -- 172.21.15.33:0/2164186370 learned_addr learned my addr 172.21.15.33:0/2164186370 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5f59e700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce6016add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5e59c700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce60069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 -- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 msgr2=0x7fce60069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce60069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 -- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 msgr2=0x7fce6016add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce6016add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 -- 172.21.15.33:0/2164186370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009ae0 con 0x7fce600686a0 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5f59e700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce60155760 0x7fce6016add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5e59c700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce60155390 0x7fce60069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-15T17:57:16.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.303+0000 7fce5ed9d700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce600686a0 0x7fce6014d200 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce5000e930 tx=0x7fce500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000eed0 con 0x7fce600686a0 2024-08-15T17:57:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000c8e0 con 0x7fce600686a0 2024-08-15T17:57:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48009420 con 0x7fce600686a0 2024-08-15T17:57:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000cc80 con 0x7fce600686a0 2024-08-15T17:57:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600ab2d0 con 0x7fce600686a0 2024-08-15T17:57:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce600644b0 con 0x7fce600686a0 2024-08-15T17:57:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fce50013680 con 0x7fce600686a0 2024-08-15T17:57:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce40060860 0x7fce40062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fce5007cbf0 con 0x7fce600686a0 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7fce400665e0 0x7fce400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce5e59c700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce40060860 0x7fce40062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 --> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce400690a0 con 0x7fce400665e0 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce5007f230 con 0x7fce600686a0 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.307+0000 7fce5f59e700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7fce400665e0 0x7fce400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.311+0000 7fce5f59e700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7fce400665e0 0x7fce400689f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.311+0000 7fce5e59c700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce40060860 0x7fce40062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fce6006a3a0 tx=0x7fce48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.311+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== osd.3 v2:172.21.15.33:6816/24181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fce400690a0 con 0x7fce400665e0 2024-08-15T17:57:16.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 --> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce6006b8c0 con 0x7fce400665e0 2024-08-15T17:57:16.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce56ffd700 1 -- 172.21.15.33:0/2164186370 <== osd.3 v2:172.21.15.33:6816/24181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fce6006b8c0 con 0x7fce400665e0 2024-08-15T17:57:16.328 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:16.328 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:16.329 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7fce400665e0 msgr2=0x7fce400689f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:6816/24181,v1:172.21.15.33:6817/24181] conn(0x7fce400665e0 0x7fce400689f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce40060860 msgr2=0x7fce40062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce40060860 0x7fce40062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fce6006a3a0 tx=0x7fce48017000 comp rx=0 tx=0).stop 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce600686a0 msgr2=0x7fce6014d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 --2- 172.21.15.33:0/2164186370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce600686a0 0x7fce6014d200 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce5000e930 tx=0x7fce500091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce5f59e700 1 -- 172.21.15.33:0/2164186370 reap_dead start 2024-08-15T17:57:16.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 shutdown_connections 2024-08-15T17:57:16.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 >> 172.21.15.33:0/2164186370 conn(0x7fce600ccfe0 msgr2=0x7fce600afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 shutdown_connections 2024-08-15T17:57:16.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.327+0000 7fce64951700 1 -- 172.21.15.33:0/2164186370 wait complete. 2024-08-15T17:57:16.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-15T17:57:16.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 Processor -- start 2024-08-15T17:57:16.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 -- start start 2024-08-15T17:57:16.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2bd00adf10 0x7f2bd00ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd006e470 0x7f2bd006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00cb890 con 0x7f2bd00cad40 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd0158290 con 0x7f2bd00adf10 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bd5911700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01610c0 con 0x7f2bd006e470 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcf7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2bd00cad40 0x7f2bd00cb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51608/0 (socket says 172.21.15.33:51608) 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcf7fe700 1 -- 172.21.15.33:0/2159374670 learned_addr learned my addr 172.21.15.33:0/2159374670 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:16.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bceffd700 1 --2- 172.21.15.33:0/2159374670 >> v2:172.21.15.33:3300/0 conn(0x7f2bd00adf10 0x7f2bd00ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bce7fc700 1 --2- 172.21.15.33:0/2159374670 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd006e470 0x7f2bd006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcdffb700 1 -- 172.21.15.33:0/2159374670 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926343864 0 0) 0x7f2bd00cb890 con 0x7f2bd00cad40 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcdffb700 1 -- 172.21.15.33:0/2159374670 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb8003570 con 0x7f2bd00cad40 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bceffd700 1 -- 172.21.15.33:0/2159374670 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd006e470 msgr2=0x7f2bd006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bceffd700 1 --2- 172.21.15.33:0/2159374670 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd006e470 0x7f2bd006e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bceffd700 1 -- 172.21.15.33:0/2159374670 >> v1:172.21.15.33:6789/0 conn(0x7f2bd00cad40 legacy=0x7f2bd00cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bceffd700 1 -- 172.21.15.33:0/2159374670 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00ae820 con 0x7f2bd00adf10 2024-08-15T17:57:16.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bceffd700 1 --2- 172.21.15.33:0/2159374670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd00ae2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40098e0 tx=0x7f2bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f024b6e034354536 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcdffb700 1 -- 172.21.15.33:0/2159374670 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011630 con 0x7f2bd00adf10 2024-08-15T17:57:16.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcdffb700 1 -- 172.21.15.33:0/2159374670 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4011790 con 0x7f2bd00adf10 2024-08-15T17:57:16.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.451+0000 7f2bcdffb700 1 -- 172.21.15.33:0/2159374670 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011b30 con 0x7f2bd00adf10 2024-08-15T17:57:16.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- 172.21.15.33:0/2159374670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 msgr2=0x7f2bd00ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 --2- 172.21.15.33:0/2159374670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd00ae2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40098e0 tx=0x7f2bc40091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- 172.21.15.33:0/2159374670 shutdown_connections 2024-08-15T17:57:16.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 --2- 172.21.15.33:0/2159374670 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd006e470 0x7f2bd006e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 --2- 172.21.15.33:0/2159374670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd00ae2e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- 172.21.15.33:0/2159374670 >> 172.21.15.33:0/2159374670 conn(0x7f2bd0067810 msgr2=0x7f2bd0067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- 172.21.15.33:0/2159374670 shutdown_connections 2024-08-15T17:57:16.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- 172.21.15.33:0/2159374670 wait complete. 2024-08-15T17:57:16.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 Processor -- start 2024-08-15T17:57:16.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- start start 2024-08-15T17:57:16.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd006e470 0x7f2bd01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd0147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd00cad40 0x7f2bd0148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0148640 con 0x7f2bd00adf10 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0158920 con 0x7f2bd006e470 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bd5911700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0097210 con 0x7f2bd00cad40 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bce7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd0147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bce7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd0147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59772/0 (socket says 172.21.15.33:59772) 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bce7fc700 1 -- 172.21.15.33:0/595091647 learned_addr learned my addr 172.21.15.33:0/595091647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bceffd700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd006e470 0x7f2bd01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.455+0000 7f2bcf7fe700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd00cad40 0x7f2bd0148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bce7fc700 1 -- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd00cad40 msgr2=0x7f2bd0148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bce7fc700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd00cad40 0x7f2bd0148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bce7fc700 1 -- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd006e470 msgr2=0x7f2bd01583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bce7fc700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd006e470 0x7f2bd01583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bce7fc700 1 -- 172.21.15.33:0/595091647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4009420 con 0x7f2bd00adf10 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bce7fc700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd0147bc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000e930 tx=0x7f2bc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0013680 con 0x7f2bd00adf10 2024-08-15T17:57:16.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc00137e0 con 0x7f2bd00adf10 2024-08-15T17:57:16.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd00974f0 con 0x7f2bd00adf10 2024-08-15T17:57:16.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0013b80 con 0x7f2bd00adf10 2024-08-15T17:57:16.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd0097ab0 con 0x7f2bd00adf10 2024-08-15T17:57:16.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.459+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd00645c0 con 0x7f2bd00adf10 2024-08-15T17:57:16.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.463+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2bc000c3e0 con 0x7f2bd00adf10 2024-08-15T17:57:16.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.463+0000 7f2bb6ffd700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2bbc060860 0x7f2bbc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.463+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2bc007c990 con 0x7f2bd00adf10 2024-08-15T17:57:16.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.463+0000 7f2bceffd700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2bbc060860 0x7f2bbc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.463+0000 7f2bceffd700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2bbc060860 0x7f2bbc062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40091e0 tx=0x7f2bc4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.471+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2bc004d080 con 0x7f2bd00adf10 2024-08-15T17:57:16.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bd006efa0 con 0x7f2bbc060860 2024-08-15T17:57:16.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bb6ffd700 1 -- 172.21.15.33:0/595091647 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2bd006efa0 con 0x7f2bbc060860 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2bbc060860 msgr2=0x7f2bbc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2bbc060860 0x7f2bbc062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40091e0 tx=0x7f2bc4017000 comp rx=0 tx=0).stop 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 msgr2=0x7f2bd0147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd0147bc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000e930 tx=0x7f2bc00091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 shutdown_connections 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2bbc060860 0x7f2bbc062d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2bd00cad40 0x7f2bd0148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bd00adf10 0x7f2bd0147bc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 --2- 172.21.15.33:0/595091647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd006e470 0x7f2bd01583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 >> 172.21.15.33:0/595091647 conn(0x7f2bd0067810 msgr2=0x7f2bd00691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 shutdown_connections 2024-08-15T17:57:16.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.631+0000 7f2bd5911700 1 -- 172.21.15.33:0/595091647 wait complete. 2024-08-15T17:57:16.636 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 3 to deep-scrub 2024-08-15T17:57:16.652 INFO:tasks.ceph:Scrubbing osd.4 2024-08-15T17:57:16.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:16.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.763+0000 7f3919a3f700 1 Processor -- start 2024-08-15T17:57:16.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.763+0000 7f3919a3f700 1 -- start start 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39140b2e70 0x7f39140cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f39140cc230 0x7f39140c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140c5bb0 con 0x7f39140ce640 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39140b32f0 con 0x7f39140cc230 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39140c4fa0 con 0x7f39140b2e70 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f391923e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f39140cc230 0x7f39140c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3918a3d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f39140ce640 0x7f39140cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51620/0 (socket says 172.21.15.33:51620) 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3918a3d700 1 -- 172.21.15.33:0/1806168635 learned_addr learned my addr 172.21.15.33:0/1806168635 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f390bfff700 1 --2- 172.21.15.33:0/1806168635 >> v2:172.21.15.105:3300/0 conn(0x7f39140b2e70 0x7f39140cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f391923e700 1 -- 172.21.15.33:0/1806168635 >> v2:172.21.15.105:3300/0 conn(0x7f39140b2e70 msgr2=0x7f39140cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f391923e700 1 --2- 172.21.15.33:0/1806168635 >> v2:172.21.15.105:3300/0 conn(0x7f39140b2e70 0x7f39140cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f391923e700 1 -- 172.21.15.33:0/1806168635 >> v1:172.21.15.33:6789/0 conn(0x7f39140ce640 legacy=0x7f39140cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f390b7fe700 1 -- 172.21.15.33:0/1806168635 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387650091 0 0) 0x7f39140c5bb0 con 0x7f39140ce640 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f391923e700 1 -- 172.21.15.33:0/1806168635 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140c5280 con 0x7f39140cc230 2024-08-15T17:57:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f391923e700 1 --2- 172.21.15.33:0/1806168635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f39140c6040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f39140ca6a0 tx=0x7f390c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ff234238cdb9d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f390b7fe700 1 -- 172.21.15.33:0/1806168635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00e070 con 0x7f39140cc230 2024-08-15T17:57:16.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f390b7fe700 1 -- 172.21.15.33:0/1806168635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c00bb60 con 0x7f39140cc230 2024-08-15T17:57:16.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f390b7fe700 1 -- 172.21.15.33:0/1806168635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c012430 con 0x7f39140cc230 2024-08-15T17:57:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 -- 172.21.15.33:0/1806168635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 msgr2=0x7f39140c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 --2- 172.21.15.33:0/1806168635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f39140c6040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f39140ca6a0 tx=0x7f390c009780 comp rx=0 tx=0).stop 2024-08-15T17:57:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 -- 172.21.15.33:0/1806168635 shutdown_connections 2024-08-15T17:57:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 --2- 172.21.15.33:0/1806168635 >> v2:172.21.15.105:3300/0 conn(0x7f39140b2e70 0x7f39140cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 --2- 172.21.15.33:0/1806168635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f39140c6040 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.767+0000 7f3919a3f700 1 -- 172.21.15.33:0/1806168635 >> 172.21.15.33:0/1806168635 conn(0x7f3914099410 msgr2=0x7f39140675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 -- 172.21.15.33:0/1806168635 shutdown_connections 2024-08-15T17:57:16.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 -- 172.21.15.33:0/1806168635 wait complete. 2024-08-15T17:57:16.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 Processor -- start 2024-08-15T17:57:16.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 -- start start 2024-08-15T17:57:16.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39140b2e70 0x7f39140c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f3914169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39140ce640 0x7f391409aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39140c7180 con 0x7f39140cc230 2024-08-15T17:57:16.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39140c7460 con 0x7f39140ce640 2024-08-15T17:57:16.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.771+0000 7f3919a3f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3914169b90 con 0x7f39140b2e70 2024-08-15T17:57:16.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f3914169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f3914169320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59790/0 (socket says 172.21.15.33:59790) 2024-08-15T17:57:16.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 -- 172.21.15.33:0/1786030251 learned_addr learned my addr 172.21.15.33:0/1786030251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:16.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f391923e700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39140ce640 0x7f391409aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3918a3d700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39140b2e70 0x7f39140c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 -- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39140b2e70 msgr2=0x7f39140c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39140b2e70 0x7f39140c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 -- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39140ce640 msgr2=0x7f391409aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39140ce640 0x7f391409aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 -- 172.21.15.33:0/1786030251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c009a20 con 0x7f39140cc230 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f390bfff700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f3914169320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f390400e960 tx=0x7f39040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904013680 con 0x7f39140cc230 2024-08-15T17:57:16.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040137e0 con 0x7f39140cc230 2024-08-15T17:57:16.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3914169e70 con 0x7f39140cc230 2024-08-15T17:57:16.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904013ba0 con 0x7f39140cc230 2024-08-15T17:57:16.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391409b420 con 0x7f39140cc230 2024-08-15T17:57:16.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.775+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f391408a1f0 con 0x7f39140cc230 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3904025420 con 0x7f39140cc230 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3908ff9700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3900060860 0x7f3900062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f390407cd40 con 0x7f39140cc230 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3908ff9700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7f3900066750 0x7f3900068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 --> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3900069210 con 0x7f3900066750 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f390407d030 con 0x7f39140cc230 2024-08-15T17:57:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3918a3d700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3900060860 0x7f3900062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f391923e700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7f3900066750 0x7f3900068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f3918a3d700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3900060860 0x7f3900062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3910007fd0 tx=0x7f3910007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.779+0000 7f391923e700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7f3900066750 0x7f3900068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.783+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== osd.4 v2:172.21.15.105:6824/24428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3900069210 con 0x7f3900066750 2024-08-15T17:57:16.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.795+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 --> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f391416a260 con 0x7f3900066750 2024-08-15T17:57:16.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3908ff9700 1 -- 172.21.15.33:0/1786030251 <== osd.4 v2:172.21.15.105:6824/24428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f391416a260 con 0x7f3900066750 2024-08-15T17:57:16.800 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:16.800 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:16.801 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7f3900066750 msgr2=0x7f3900068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6824/24428,v1:172.21.15.105:6825/24428] conn(0x7f3900066750 0x7f3900068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3900060860 msgr2=0x7f3900062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f3900060860 0x7f3900062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3910007fd0 tx=0x7f3910007d30 comp rx=0 tx=0).stop 2024-08-15T17:57:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 msgr2=0x7f3914169320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 --2- 172.21.15.33:0/1786030251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39140cc230 0x7f3914169320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f390400e960 tx=0x7f39040091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f391923e700 1 -- 172.21.15.33:0/1786030251 reap_dead start 2024-08-15T17:57:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 shutdown_connections 2024-08-15T17:57:16.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 >> 172.21.15.33:0/1786030251 conn(0x7f3914099410 msgr2=0x7f39141576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 shutdown_connections 2024-08-15T17:57:16.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.799+0000 7f3919a3f700 1 -- 172.21.15.33:0/1786030251 wait complete. 2024-08-15T17:57:16.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-15T17:57:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.919+0000 7fce6af4e700 1 Processor -- start 2024-08-15T17:57:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.919+0000 7fce6af4e700 1 -- start start 2024-08-15T17:57:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce640cd1b0 0x7fce641536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce6415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6415a610 con 0x7fce64153320 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640ce430 con 0x7fce640cd1b0 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6415dbd0 con 0x7fce6415a190 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6974b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce640cd1b0 0x7fce641536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce69f4c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fce64153320 0x7fce640ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51626/0 (socket says 172.21.15.33:51626) 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce69f4c700 1 -- 172.21.15.33:0/3060127490 learned_addr learned my addr 172.21.15.33:0/3060127490 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6a74d700 1 --2- 172.21.15.33:0/3060127490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce6415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6974b700 1 -- 172.21.15.33:0/3060127490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 msgr2=0x7fce6415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6974b700 1 --2- 172.21.15.33:0/3060127490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce6415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6974b700 1 -- 172.21.15.33:0/3060127490 >> v1:172.21.15.33:6789/0 conn(0x7fce64153320 legacy=0x7fce640ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6974b700 1 -- 172.21.15.33:0/3060127490 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6415d370 con 0x7fce640cd1b0 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce68f4a700 1 -- 172.21.15.33:0/3060127490 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968086757 0 0) 0x7fce6415a610 con 0x7fce64153320 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6974b700 1 --2- 172.21.15.33:0/3060127490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce640cd1b0 0x7fce641536f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce58009910 tx=0x7fce580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75832fbf195c4afe server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce68f4a700 1 -- 172.21.15.33:0/3060127490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800b640 con 0x7fce640cd1b0 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce68f4a700 1 -- 172.21.15.33:0/3060127490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5800b7a0 con 0x7fce640cd1b0 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce68f4a700 1 -- 172.21.15.33:0/3060127490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800bb60 con 0x7fce640cd1b0 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- 172.21.15.33:0/3060127490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce640cd1b0 msgr2=0x7fce641536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3060127490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce640cd1b0 0x7fce641536f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce58009910 tx=0x7fce580091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- 172.21.15.33:0/3060127490 shutdown_connections 2024-08-15T17:57:16.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3060127490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce6415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3060127490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce640cd1b0 0x7fce641536f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- 172.21.15.33:0/3060127490 >> 172.21.15.33:0/3060127490 conn(0x7fce640d00a0 msgr2=0x7fce640d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- 172.21.15.33:0/3060127490 shutdown_connections 2024-08-15T17:57:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.923+0000 7fce6af4e700 1 -- 172.21.15.33:0/3060127490 wait complete. 2024-08-15T17:57:16.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 Processor -- start 2024-08-15T17:57:16.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 -- start start 2024-08-15T17:57:16.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 0x7fce640b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce640b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce64169210 0x7fce64152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce641696a0 con 0x7fce64153320 2024-08-15T17:57:16.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64169980 con 0x7fce64169210 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce64169c60 con 0x7fce6415a190 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 0x7fce640b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 0x7fce640b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59806/0 (socket says 172.21.15.33:59806) 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 -- 172.21.15.33:0/3710142601 learned_addr learned my addr 172.21.15.33:0/3710142601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6974b700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce640b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6a74d700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce64169210 0x7fce64152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 -- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 msgr2=0x7fce640b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce640b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 -- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce64169210 msgr2=0x7fce64152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce64169210 0x7fce64152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 -- 172.21.15.33:0/3710142601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009420 con 0x7fce64153320 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6a74d700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce64169210 0x7fce64152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce69f4c700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 0x7fce640b3670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c7e0 tx=0x7fce60007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60005b30 con 0x7fce64153320 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce60005c90 con 0x7fce64153320 2024-08-15T17:57:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce64169f40 con 0x7fce64153320 2024-08-15T17:57:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60007300 con 0x7fce64153320 2024-08-15T17:57:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.927+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce640b59a0 con 0x7fce64153320 2024-08-15T17:57:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.931+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640638f0 con 0x7fce64153320 2024-08-15T17:57:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.931+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fce600076b0 con 0x7fce64153320 2024-08-15T17:57:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.931+0000 7fce55ffb700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce48060860 0x7fce48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.931+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fce6007beb0 con 0x7fce64153320 2024-08-15T17:57:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.931+0000 7fce6974b700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce48060860 0x7fce48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.935+0000 7fce6974b700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce48060860 0x7fce48062d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce58009910 tx=0x7fce58017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:16.939+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fce6004c5a0 con 0x7fce64153320 2024-08-15T17:57:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.099+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fce640cde20 con 0x7fce48060860 2024-08-15T17:57:17.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce55ffb700 1 -- 172.21.15.33:0/3710142601 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fce640cde20 con 0x7fce48060860 2024-08-15T17:57:17.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce48060860 msgr2=0x7fce48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce48060860 0x7fce48062d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce58009910 tx=0x7fce58017000 comp rx=0 tx=0).stop 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 msgr2=0x7fce640b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 0x7fce640b3670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c7e0 tx=0x7fce60007df0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 shutdown_connections 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fce48060860 0x7fce48062d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce64169210 0x7fce64152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce6415a190 0x7fce640b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 --2- 172.21.15.33:0/3710142601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64153320 0x7fce640b3670 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 >> 172.21.15.33:0/3710142601 conn(0x7fce640d00a0 msgr2=0x7fce640cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 shutdown_connections 2024-08-15T17:57:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.103+0000 7fce6af4e700 1 -- 172.21.15.33:0/3710142601 wait complete. 2024-08-15T17:57:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 4 to deep-scrub 2024-08-15T17:57:17.117 INFO:tasks.ceph:Scrubbing osd.5 2024-08-15T17:57:17.117 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:17.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.231+0000 7f7bd3fff700 1 Processor -- start 2024-08-15T17:57:17.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.231+0000 7f7bd3fff700 1 -- start start 2024-08-15T17:57:17.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bd40ce640 0x7f7bd40b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bd40cea10 0x7f7bd40cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40cc230 0x7f7bd40c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd40c5bb0 con 0x7f7bd40cea10 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd40cc650 con 0x7f7bd40ce640 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c4fa0 con 0x7f7bd40cc230 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bd40cea10 0x7f7bd40cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bd40cea10 0x7f7bd40cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59818/0 (socket says 172.21.15.33:59818) 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 -- 172.21.15.33:0/837732374 learned_addr learned my addr 172.21.15.33:0/837732374 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd37fe700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40cc230 0x7f7bd40c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd2ffd700 1 --2- 172.21.15.33:0/837732374 >> v2:172.21.15.105:3300/0 conn(0x7f7bd40ce640 0x7f7bd40b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 -- 172.21.15.33:0/837732374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40cc230 msgr2=0x7f7bd40c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40cc230 0x7f7bd40c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 -- 172.21.15.33:0/837732374 >> v2:172.21.15.105:3300/0 conn(0x7f7bd40ce640 msgr2=0x7f7bd40b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/837732374 >> v2:172.21.15.105:3300/0 conn(0x7f7bd40ce640 0x7f7bd40b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 -- 172.21.15.33:0/837732374 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40c5280 con 0x7f7bd40cea10 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd2ffd700 1 --2- 172.21.15.33:0/837732374 >> v2:172.21.15.105:3300/0 conn(0x7f7bd40ce640 0x7f7bd40b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:17.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd37fe700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40cc230 0x7f7bd40c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:17.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd40cbcf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40d0030 tx=0x7f7bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f79196bf13c597 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd1ffb700 1 -- 172.21.15.33:0/837732374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00b860 con 0x7f7bd40cea10 2024-08-15T17:57:17.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd1ffb700 1 -- 172.21.15.33:0/837732374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00b9c0 con 0x7f7bd40cea10 2024-08-15T17:57:17.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd1ffb700 1 -- 172.21.15.33:0/837732374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00bd60 con 0x7f7bd40cea10 2024-08-15T17:57:17.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- 172.21.15.33:0/837732374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 msgr2=0x7f7bd40cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd40cbcf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40d0030 tx=0x7f7bbc009250 comp rx=0 tx=0).stop 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- 172.21.15.33:0/837732374 shutdown_connections 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40cc230 0x7f7bd40c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/837732374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd40cbcf0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/837732374 >> v2:172.21.15.105:3300/0 conn(0x7f7bd40ce640 0x7f7bd40b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- 172.21.15.33:0/837732374 >> 172.21.15.33:0/837732374 conn(0x7f7bd4099410 msgr2=0x7f7bd40675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- 172.21.15.33:0/837732374 shutdown_connections 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.235+0000 7f7bd3fff700 1 -- 172.21.15.33:0/837732374 wait complete. 2024-08-15T17:57:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 Processor -- start 2024-08-15T17:57:17.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 -- start start 2024-08-15T17:57:17.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd40cc230 0x7f7bd40c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40ce640 0x7f7bd4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4156b80 con 0x7f7bd40cea10 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4156d10 con 0x7f7bd40cc230 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c8170 con 0x7f7bd40ce640 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd4152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59826/0 (socket says 172.21.15.33:59826) 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 -- 172.21.15.33:0/3846155176 learned_addr learned my addr 172.21.15.33:0/3846155176 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd2ffd700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd40cc230 0x7f7bd40c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40ce640 0x7f7bd4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 -- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40ce640 msgr2=0x7f7bd4151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40ce640 0x7f7bd4151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 -- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd40cc230 msgr2=0x7f7bd40c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd40cc230 0x7f7bd40c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 -- 172.21.15.33:0/3846155176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc0094f0 con 0x7f7bd40cea10 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd40ce640 0x7f7bd4151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd37fe700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd4152970 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009fc0 tx=0x7f7bcc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00dd40 con 0x7f7bd40cea10 2024-08-15T17:57:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00f040 con 0x7f7bd40cea10 2024-08-15T17:57:17.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd40c8450 con 0x7f7bd40cea10 2024-08-15T17:57:17.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc015690 con 0x7f7bd40cea10 2024-08-15T17:57:17.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.239+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd40c8a10 con 0x7f7bd40cea10 2024-08-15T17:57:17.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bd40644b0 con 0x7f7bd40cea10 2024-08-15T17:57:17.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7bcc01e3b0 con 0x7f7bd40cea10 2024-08-15T17:57:17.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bcaffd700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7bb4060860 0x7f7bb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7bcc07d610 con 0x7f7bd40cea10 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bcaffd700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7f7bb4066750 0x7f7bb4068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 --> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bb4069210 con 0x7f7bb4066750 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bcc07d9e0 con 0x7f7bd40cea10 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bd2ffd700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7bb4060860 0x7f7bb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.243+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7f7bb4066750 0x7f7bb4068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.247+0000 7f7bd2ffd700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7bb4060860 0x7f7bb4062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4006fd0 tx=0x7f7bc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.247+0000 7f7bd27fc700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7f7bb4066750 0x7f7bb4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.247+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== osd.5 v2:172.21.15.105:6800/24429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7bb4069210 con 0x7f7bb4066750 2024-08-15T17:57:17.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 --> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7bd40ca480 con 0x7f7bb4066750 2024-08-15T17:57:17.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bcaffd700 1 -- 172.21.15.33:0/3846155176 <== osd.5 v2:172.21.15.105:6800/24429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7bd40ca480 con 0x7f7bb4066750 2024-08-15T17:57:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:17.265 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:17.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7f7bb4066750 msgr2=0x7f7bb4068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6800/24429,v1:172.21.15.105:6801/24429] conn(0x7f7bb4066750 0x7f7bb4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7bb4060860 msgr2=0x7f7bb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f7bb4060860 0x7f7bb4062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4006fd0 tx=0x7f7bc4008040 comp rx=0 tx=0).stop 2024-08-15T17:57:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 msgr2=0x7f7bd4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 --2- 172.21.15.33:0/3846155176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd40cea10 0x7f7bd4152970 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009fc0 tx=0x7f7bcc0099b0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd37fe700 1 -- 172.21.15.33:0/3846155176 reap_dead start 2024-08-15T17:57:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 shutdown_connections 2024-08-15T17:57:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 >> 172.21.15.33:0/3846155176 conn(0x7f7bd4099410 msgr2=0x7f7bd40cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 shutdown_connections 2024-08-15T17:57:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.263+0000 7f7bd3fff700 1 -- 172.21.15.33:0/3846155176 wait complete. 2024-08-15T17:57:17.278 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-15T17:57:17.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.383+0000 7f21ad959700 1 Processor -- start 2024-08-15T17:57:17.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad959700 1 -- start start 2024-08-15T17:57:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad959700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21a8153320 0x7f21a81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad959700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad959700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a815dbd0 con 0x7f21a815a190 2024-08-15T17:57:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad959700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80ce430 con 0x7f21a8153320 2024-08-15T17:57:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad959700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a815d370 con 0x7f21a80cd1b0 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21a8153320 0x7f21a81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21a8153320 0x7f21a81536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:53736/0 (socket says 172.21.15.33:53736) 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 -- 172.21.15.33:0/2271479236 learned_addr learned my addr 172.21.15.33:0/2271479236 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ad158700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21a7fff700 1 --1- 172.21.15.33:0/2271479236 >> v1:172.21.15.105:6789/0 conn(0x7f21a815a190 0x7f21a80ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.33:33514/0 (socket says 172.21.15.33:33514) 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 -- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 msgr2=0x7f21a815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 --2- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 -- 172.21.15.33:0/2271479236 >> v1:172.21.15.105:6789/0 conn(0x7f21a815a190 legacy=0x7f21a80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 -- 172.21.15.33:0/2271479236 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a815a590 con 0x7f21a8153320 2024-08-15T17:57:17.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21ac957700 1 --2- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8153320 0x7f21a81536f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21980099b0 tx=0x7f2198009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570669bbeff72435 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21a77fe700 1 -- 172.21.15.33:0/2271479236 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198009ea0 con 0x7f21a8153320 2024-08-15T17:57:17.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21a77fe700 1 -- 172.21.15.33:0/2271479236 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219800b860 con 0x7f21a8153320 2024-08-15T17:57:17.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.387+0000 7f21a77fe700 1 -- 172.21.15.33:0/2271479236 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800bc00 con 0x7f21a8153320 2024-08-15T17:57:17.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8153320 msgr2=0x7f21a81536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 --2- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8153320 0x7f21a81536f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21980099b0 tx=0x7f2198009250 comp rx=0 tx=0).stop 2024-08-15T17:57:17.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- 172.21.15.33:0/2271479236 shutdown_connections 2024-08-15T17:57:17.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 --2- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 --2- 172.21.15.33:0/2271479236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8153320 0x7f21a81536f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- 172.21.15.33:0/2271479236 >> 172.21.15.33:0/2271479236 conn(0x7f21a80d00a0 msgr2=0x7f21a80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- 172.21.15.33:0/2271479236 shutdown_connections 2024-08-15T17:57:17.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- 172.21.15.33:0/2271479236 wait complete. 2024-08-15T17:57:17.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 Processor -- start 2024-08-15T17:57:17.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- start start 2024-08-15T17:57:17.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 0x7f21a80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815a190 0x7f21a80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80c67b0 con 0x7f21a8153320 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80b5370 con 0x7f21a815a190 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.391+0000 7f21ad959700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80c5c30 con 0x7f21a80cd1b0 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 0x7f21a80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 0x7f21a80b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59842/0 (socket says 172.21.15.33:59842) 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 -- 172.21.15.33:0/442856947 learned_addr learned my addr 172.21.15.33:0/442856947 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21ad158700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815a190 0x7f21a80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21ac957700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 -- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 msgr2=0x7f21a80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 -- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815a190 msgr2=0x7f21a80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815a190 0x7f21a80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 -- 172.21.15.33:0/442856947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980094f0 con 0x7f21a8153320 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a7fff700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 0x7f21a80b36f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c590 tx=0x7f219c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c005a70 con 0x7f21a8153320 2024-08-15T17:57:17.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c005bd0 con 0x7f21a8153320 2024-08-15T17:57:17.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a80c5f10 con 0x7f21a8153320 2024-08-15T17:57:17.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c0070d0 con 0x7f21a8153320 2024-08-15T17:57:17.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a80c64d0 con 0x7f21a8153320 2024-08-15T17:57:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a80b2ed0 con 0x7f21a8153320 2024-08-15T17:57:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.395+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f219c007480 con 0x7f21a8153320 2024-08-15T17:57:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.399+0000 7f21a4ff9700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2194060860 0x7f2194062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.399+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f219c07bcb0 con 0x7f21a8153320 2024-08-15T17:57:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.399+0000 7f21ac957700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2194060860 0x7f2194062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.399+0000 7f21ac957700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2194060860 0x7f2194062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21980099b0 tx=0x7f2198017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.403+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f21a80b2ed0 con 0x7f21a8153320 2024-08-15T17:57:17.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.567+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f21a80b2ed0 con 0x7f2194060860 2024-08-15T17:57:17.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.567+0000 7f21a4ff9700 1 -- 172.21.15.33:0/442856947 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21a80b2ed0 con 0x7f2194060860 2024-08-15T17:57:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2194060860 msgr2=0x7f2194062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2194060860 0x7f2194062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21980099b0 tx=0x7f2198017000 comp rx=0 tx=0).stop 2024-08-15T17:57:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 msgr2=0x7f21a80b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 0x7f21a80b36f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c590 tx=0x7f219c007f70 comp rx=0 tx=0).stop 2024-08-15T17:57:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 shutdown_connections 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f2194060860 0x7f2194062d10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815a190 0x7f21a80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8153320 0x7f21a80b36f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 --2- 172.21.15.33:0/442856947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80cd1b0 0x7f21a80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 >> 172.21.15.33:0/442856947 conn(0x7f21a80d00a0 msgr2=0x7f21a80ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 shutdown_connections 2024-08-15T17:57:17.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.571+0000 7f21ad959700 1 -- 172.21.15.33:0/442856947 wait complete. 2024-08-15T17:57:17.574 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 5 to deep-scrub 2024-08-15T17:57:17.589 INFO:tasks.ceph:Scrubbing osd.6 2024-08-15T17:57:17.589 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.703+0000 7f8299660700 1 Processor -- start 2024-08-15T17:57:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.703+0000 7f8299660700 1 -- start start 2024-08-15T17:57:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82940ca870 0x7f82940cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940a9990 0x7f8294155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8294155df0 con 0x7f8294155990 2024-08-15T17:57:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940ca4c0 con 0x7f82940ca870 2024-08-15T17:57:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829406eb90 con 0x7f82940a9990 2024-08-15T17:57:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82940ca870 0x7f82940cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82940ca870 0x7f82940cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59850/0 (socket says 172.21.15.33:59850) 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 -- 172.21.15.33:0/821007778 learned_addr learned my addr 172.21.15.33:0/821007778 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f82927fc700 1 --2- 172.21.15.33:0/821007778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940a9990 0x7f8294155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 -- 172.21.15.33:0/821007778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940a9990 msgr2=0x7f8294155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8291ffb700 1 -- 172.21.15.33:0/821007778 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592797118 0 0) 0x7f8294155df0 con 0x7f8294155990 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 --2- 172.21.15.33:0/821007778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940a9990 0x7f8294155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 -- 172.21.15.33:0/821007778 >> v1:172.21.15.105:6789/0 conn(0x7f8294155990 legacy=0x7f82940c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 -- 172.21.15.33:0/821007778 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829406ee70 con 0x7f82940ca870 2024-08-15T17:57:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8292ffd700 1 --2- 172.21.15.33:0/821007778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940ca870 0x7f82940cac40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82880099b0 tx=0x7f8288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1eb8e40f808890 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8291ffb700 1 -- 172.21.15.33:0/821007778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288009ea0 con 0x7f82940ca870 2024-08-15T17:57:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8291ffb700 1 -- 172.21.15.33:0/821007778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828800b8f0 con 0x7f82940ca870 2024-08-15T17:57:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8291ffb700 1 -- 172.21.15.33:0/821007778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800bc90 con 0x7f82940ca870 2024-08-15T17:57:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- 172.21.15.33:0/821007778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940ca870 msgr2=0x7f82940cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 --2- 172.21.15.33:0/821007778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940ca870 0x7f82940cac40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82880099b0 tx=0x7f8288009250 comp rx=0 tx=0).stop 2024-08-15T17:57:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- 172.21.15.33:0/821007778 shutdown_connections 2024-08-15T17:57:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 --2- 172.21.15.33:0/821007778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940a9990 0x7f8294155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 --2- 172.21.15.33:0/821007778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940ca870 0x7f82940cac40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- 172.21.15.33:0/821007778 >> 172.21.15.33:0/821007778 conn(0x7f82940c93a0 msgr2=0x7f8294066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- 172.21.15.33:0/821007778 shutdown_connections 2024-08-15T17:57:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.707+0000 7f8299660700 1 -- 172.21.15.33:0/821007778 wait complete. 2024-08-15T17:57:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 Processor -- start 2024-08-15T17:57:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 -- start start 2024-08-15T17:57:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940a9990 0x7f8294164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940ca870 0x7f82940c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8294155990 0x7f8294153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c7b70 con 0x7f82940a9990 2024-08-15T17:57:17.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940ab2c0 con 0x7f8294155990 2024-08-15T17:57:17.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8299660700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940ab5a0 con 0x7f82940ca870 2024-08-15T17:57:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8292ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940a9990 0x7f8294164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8292ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940a9990 0x7f8294164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59864/0 (socket says 172.21.15.33:59864) 2024-08-15T17:57:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8292ffd700 1 -- 172.21.15.33:0/138008244 learned_addr learned my addr 172.21.15.33:0/138008244 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f82937fe700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8294155990 0x7f8294153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f82927fc700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940ca870 0x7f82940c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8292ffd700 1 -- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940ca870 msgr2=0x7f82940c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.711+0000 7f8292ffd700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940ca870 0x7f82940c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8292ffd700 1 -- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8294155990 msgr2=0x7f8294153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8292ffd700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8294155990 0x7f8294153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8292ffd700 1 -- 172.21.15.33:0/138008244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880094f0 con 0x7f82940a9990 2024-08-15T17:57:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f82927fc700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940ca870 0x7f82940c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8292ffd700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940a9990 0x7f8294164dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8288006fd0 tx=0x7f8288017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800bb30 con 0x7f82940a9990 2024-08-15T17:57:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288026430 con 0x7f82940a9990 2024-08-15T17:57:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800bc90 con 0x7f82940a9990 2024-08-15T17:57:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82940ab880 con 0x7f82940a9990 2024-08-15T17:57:17.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940abe40 con 0x7f82940a9990 2024-08-15T17:57:17.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82940638f0 con 0x7f82940a9990 2024-08-15T17:57:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.715+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8288023030 con 0x7f82940a9990 2024-08-15T17:57:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f827affd700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8280060860 0x7f8280062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f828807e1a0 con 0x7f82940a9990 2024-08-15T17:57:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f827affd700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f8280066750 0x7f8280068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 --> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8280069210 con 0x7f8280066750 2024-08-15T17:57:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82880806a0 con 0x7f82940a9990 2024-08-15T17:57:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f82927fc700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8280060860 0x7f8280062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f82937fe700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f8280066750 0x7f8280068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f82927fc700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8280060860 0x7f8280062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82940c7350 tx=0x7f8284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f82937fe700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f8280066750 0x7f8280068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.719+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== osd.6 v2:172.21.15.105:6816/24430 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8280069210 con 0x7f8280066750 2024-08-15T17:57:17.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 --> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8294070a70 con 0x7f8280066750 2024-08-15T17:57:17.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f827affd700 1 -- 172.21.15.33:0/138008244 <== osd.6 v2:172.21.15.105:6816/24430 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8294070a70 con 0x7f8280066750 2024-08-15T17:57:17.741 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:17.741 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:17.742 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:17.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f8280066750 msgr2=0x7f8280068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6816/24430,v1:172.21.15.105:6817/24430] conn(0x7f8280066750 0x7f8280068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8280060860 msgr2=0x7f8280062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8280060860 0x7f8280062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82940c7350 tx=0x7f8284008040 comp rx=0 tx=0).stop 2024-08-15T17:57:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940a9990 msgr2=0x7f8294164dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 --2- 172.21.15.33:0/138008244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82940a9990 0x7f8294164dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8288006fd0 tx=0x7f8288017000 comp rx=0 tx=0).stop 2024-08-15T17:57:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f82937fe700 1 -- 172.21.15.33:0/138008244 reap_dead start 2024-08-15T17:57:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 shutdown_connections 2024-08-15T17:57:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 >> 172.21.15.33:0/138008244 conn(0x7f82940c93a0 msgr2=0x7f829406e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 shutdown_connections 2024-08-15T17:57:17.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.739+0000 7f8299660700 1 -- 172.21.15.33:0/138008244 wait complete. 2024-08-15T17:57:17.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-15T17:57:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 Processor -- start 2024-08-15T17:57:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 -- start start 2024-08-15T17:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa6e00b14a0 0x7fa6e00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6e00cb390 0x7fa6e0160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00cbaa0 con 0x7fa6e0154900 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e0068790 con 0x7fa6e00cb390 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e5d7b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e01583f0 con 0x7fa6e00b14a0 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e557a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6e00cb390 0x7fa6e0160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e4d79700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa6e0154900 0x7fa6e00b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59716/0 (socket says 172.21.15.33:59716) 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6e4d79700 1 -- 172.21.15.33:0/2850368053 learned_addr learned my addr 172.21.15.33:0/2850368053 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6dffff700 1 --2- 172.21.15.33:0/2850368053 >> v2:172.21.15.105:3300/0 conn(0x7fa6e00b14a0 0x7fa6e00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6df7fe700 1 -- 172.21.15.33:0/2850368053 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820187466 0 0) 0x7fa6e00cbaa0 con 0x7fa6e0154900 2024-08-15T17:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.871+0000 7fa6df7fe700 1 -- 172.21.15.33:0/2850368053 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6cc003570 con 0x7fa6e0154900 2024-08-15T17:57:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e557a700 1 -- 172.21.15.33:0/2850368053 >> v2:172.21.15.105:3300/0 conn(0x7fa6e00b14a0 msgr2=0x7fa6e00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e557a700 1 --2- 172.21.15.33:0/2850368053 >> v2:172.21.15.105:3300/0 conn(0x7fa6e00b14a0 0x7fa6e00cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e557a700 1 -- 172.21.15.33:0/2850368053 >> v1:172.21.15.33:6789/0 conn(0x7fa6e0154900 legacy=0x7fa6e00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e557a700 1 -- 172.21.15.33:0/2850368053 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0157630 con 0x7fa6e00cb390 2024-08-15T17:57:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e557a700 1 --2- 172.21.15.33:0/2850368053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00cb390 0x7fa6e0160ac0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006f390 tx=0x7fa6d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68002a0825c5068 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6df7fe700 1 -- 172.21.15.33:0/2850368053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800e070 con 0x7fa6e00cb390 2024-08-15T17:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6df7fe700 1 -- 172.21.15.33:0/2850368053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d800bab0 con 0x7fa6e00cb390 2024-08-15T17:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6df7fe700 1 -- 172.21.15.33:0/2850368053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800be70 con 0x7fa6e00cb390 2024-08-15T17:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2850368053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00cb390 msgr2=0x7fa6e0160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2850368053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00cb390 0x7fa6e0160ac0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006f390 tx=0x7fa6d8009780 comp rx=0 tx=0).stop 2024-08-15T17:57:17.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2850368053 shutdown_connections 2024-08-15T17:57:17.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2850368053 >> v2:172.21.15.105:3300/0 conn(0x7fa6e00b14a0 0x7fa6e00cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2850368053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00cb390 0x7fa6e0160ac0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2850368053 >> 172.21.15.33:0/2850368053 conn(0x7fa6e00678d0 msgr2=0x7fa6e0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2850368053 shutdown_connections 2024-08-15T17:57:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2850368053 wait complete. 2024-08-15T17:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 Processor -- start 2024-08-15T17:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.875+0000 7fa6e5d7b700 1 -- start start 2024-08-15T17:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00b14a0 0x7fa6e01435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6e00cb390 0x7fa6e015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e0154900 0x7fa6e01598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0156bb0 con 0x7fa6e00b14a0 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0156030 con 0x7fa6e0154900 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0156310 con 0x7fa6e00cb390 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00b14a0 0x7fa6e01435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e557a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e0154900 0x7fa6e01598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6dffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6e00cb390 0x7fa6e015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e557a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e0154900 0x7fa6e01598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.33:33348/0 (socket says 172.21.15.33:33348) 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e557a700 1 -- 172.21.15.33:0/2231392831 learned_addr learned my addr 172.21.15.33:0/2231392831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 -- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6e00cb390 msgr2=0x7fa6e015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6e00cb390 0x7fa6e015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 -- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e0154900 msgr2=0x7fa6e01598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e0154900 0x7fa6e01598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 -- 172.21.15.33:0/2231392831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8009a20 con 0x7fa6e00b14a0 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e4d79700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00b14a0 0x7fa6e01435d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c560 tx=0x7fa6d0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0005b30 con 0x7fa6e00b14a0 2024-08-15T17:57:17.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0005cb0 con 0x7fa6e00b14a0 2024-08-15T17:57:17.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e01565f0 con 0x7fa6e00b14a0 2024-08-15T17:57:17.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0007320 con 0x7fa6e00b14a0 2024-08-15T17:57:17.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.879+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e0143b10 con 0x7fa6e00b14a0 2024-08-15T17:57:17.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.883+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e0167090 con 0x7fa6e00b14a0 2024-08-15T17:57:17.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.883+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa6d001b3b0 con 0x7fa6e00b14a0 2024-08-15T17:57:17.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.883+0000 7fa6dcff9700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa6c0060860 0x7fa6c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:17.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.883+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa6d007bc70 con 0x7fa6e00b14a0 2024-08-15T17:57:17.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.883+0000 7fa6dffff700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa6c0060860 0x7fa6c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:17.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.887+0000 7fa6dffff700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa6c0060860 0x7fa6c0062d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0158650 tx=0x7fa6c80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:17.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:17.891+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa6e0167090 con 0x7fa6e00b14a0 2024-08-15T17:57:18.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.055+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6e0167090 con 0x7fa6c0060860 2024-08-15T17:57:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.055+0000 7fa6dcff9700 1 -- 172.21.15.33:0/2231392831 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa6e0167090 con 0x7fa6c0060860 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa6c0060860 msgr2=0x7fa6c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa6c0060860 0x7fa6c0062d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0158650 tx=0x7fa6c80091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00b14a0 msgr2=0x7fa6e01435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00b14a0 0x7fa6e01435d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c560 tx=0x7fa6d0007d50 comp rx=0 tx=0).stop 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 shutdown_connections 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fa6c0060860 0x7fa6c0062d10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e0154900 0x7fa6e01598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6e00cb390 0x7fa6e015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 --2- 172.21.15.33:0/2231392831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00b14a0 0x7fa6e01435d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 >> 172.21.15.33:0/2231392831 conn(0x7fa6e00678d0 msgr2=0x7fa6e00ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 shutdown_connections 2024-08-15T17:57:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.059+0000 7fa6e5d7b700 1 -- 172.21.15.33:0/2231392831 wait complete. 2024-08-15T17:57:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 6 to deep-scrub 2024-08-15T17:57:18.078 INFO:tasks.ceph:Scrubbing osd.7 2024-08-15T17:57:18.079 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-15T17:57:18.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.195+0000 7f028e5d0700 1 Processor -- start 2024-08-15T17:57:18.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.195+0000 7f028e5d0700 1 -- start start 2024-08-15T17:57:18.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028e5d0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f02880b2e90 0x7f02880c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028e5d0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880c5b40 con 0x7f02880b26d0 2024-08-15T17:57:18.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028e5d0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880b2aa0 con 0x7f02880cded0 2024-08-15T17:57:18.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028e5d0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880b3310 con 0x7f02880b2e90 2024-08-15T17:57:18.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028d5ce700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f02880b26d0 0x7f02880c5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59718/0 (socket says 172.21.15.33:59718) 2024-08-15T17:57:18.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028d5ce700 1 -- 172.21.15.33:0/2884371804 learned_addr learned my addr 172.21.15.33:0/2884371804 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:18.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028cdcd700 1 --2- 172.21.15.33:0/2884371804 >> v2:172.21.15.105:3300/0 conn(0x7f02880b2e90 0x7f02880c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201191900 0 0) 0x7f02880c5b40 con 0x7f02880b26d0 2024-08-15T17:57:18.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0274003570 con 0x7f02880b26d0 2024-08-15T17:57:18.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374353537 0 0) 0x7f02880b2aa0 con 0x7f02880cded0 2024-08-15T17:57:18.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02880c5b40 con 0x7f02880cded0 2024-08-15T17:57:18.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028cdcd700 1 -- 172.21.15.33:0/2884371804 >> v1:172.21.15.105:6789/0 conn(0x7f02880cded0 legacy=0x7f02880ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028cdcd700 1 -- 172.21.15.33:0/2884371804 >> v1:172.21.15.33:6789/0 conn(0x7f02880b26d0 legacy=0x7f02880c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028cdcd700 1 -- 172.21.15.33:0/2884371804 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288159820 con 0x7f02880b2e90 2024-08-15T17:57:18.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f028cdcd700 1 --2- 172.21.15.33:0/2884371804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880b2e90 0x7f02880c66e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f027c009900 tx=0x7f027c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6980d1796aa9e5f server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c005c10 con 0x7f02880b2e90 2024-08-15T17:57:18.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c005d70 con 0x7f02880b2e90 2024-08-15T17:57:18.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.199+0000 7f027bfff700 1 -- 172.21.15.33:0/2884371804 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c006240 con 0x7f02880b2e90 2024-08-15T17:57:18.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- 172.21.15.33:0/2884371804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880b2e90 msgr2=0x7f02880c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 --2- 172.21.15.33:0/2884371804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880b2e90 0x7f02880c66e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f027c009900 tx=0x7f027c009120 comp rx=0 tx=0).stop 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- 172.21.15.33:0/2884371804 shutdown_connections 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 --2- 172.21.15.33:0/2884371804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880b2e90 0x7f02880c66e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- 172.21.15.33:0/2884371804 >> 172.21.15.33:0/2884371804 conn(0x7f0288067590 msgr2=0x7f02880d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- 172.21.15.33:0/2884371804 shutdown_connections 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- 172.21.15.33:0/2884371804 wait complete. 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 Processor -- start 2024-08-15T17:57:18.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- start start 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02880b26d0 0x7f0288142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02880b2e90 0x7f02880c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880cded0 0x7f02880c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c7c20 con 0x7f02880b2e90 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028815a9e0 con 0x7f02880cded0 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028e5d0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880ca120 con 0x7f02880b26d0 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02880b2e90 0x7f02880c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02880b2e90 0x7f02880c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48316/0 (socket says 172.21.15.33:48316) 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 -- 172.21.15.33:0/2200898575 learned_addr learned my addr 172.21.15.33:0/2200898575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028d5ce700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02880b26d0 0x7f0288142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028ddcf700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880cded0 0x7f02880c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 -- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02880b26d0 msgr2=0x7f0288142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02880b26d0 0x7f0288142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 -- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880cded0 msgr2=0x7f02880c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02880cded0 0x7f02880c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028cdcd700 1 -- 172.21.15.33:0/2200898575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0093c0 con 0x7f02880b2e90 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.203+0000 7f028d5ce700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02880b26d0 0x7f0288142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f028cdcd700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02880b2e90 0x7f02880c71a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f027c009160 tx=0x7f027c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c000d10 con 0x7f02880b2e90 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c011cc0 con 0x7f02880b2e90 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c011e50 con 0x7f02880b2e90 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02880ca400 con 0x7f02880b2e90 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028815ac30 con 0x7f02880b2e90 2024-08-15T17:57:18.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02880644b0 con 0x7f02880b2e90 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f027c023020 con 0x7f02880b2e90 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.207+0000 7f02797fa700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f026c060860 0x7f026c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f027c07eb90 con 0x7f02880b2e90 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f02797fa700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f026c0665e0 0x7f026c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 --> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f026c0690a0 con 0x7f026c0665e0 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f027c07ee80 con 0x7f02880b2e90 2024-08-15T17:57:18.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f028d5ce700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f026c060860 0x7f026c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f028ddcf700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f026c0665e0 0x7f026c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f028d5ce700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f026c060860 0x7f026c062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02840058d0 tx=0x7f0284009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f028ddcf700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f026c0665e0 0x7f026c0689f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.211+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== osd.7 v2:172.21.15.105:6808/24464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f026c0690a0 con 0x7f026c0665e0 2024-08-15T17:57:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.231+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 --> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0288143380 con 0x7f026c0665e0 2024-08-15T17:57:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.231+0000 7f02797fa700 1 -- 172.21.15.33:0/2200898575 <== osd.7 v2:172.21.15.105:6808/24464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0288143380 con 0x7f026c0665e0 2024-08-15T17:57:18.235 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-15T17:57:18.235 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-15T17:57:18.235 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-15T17:57:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f026c0665e0 msgr2=0x7f026c0689f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6808/24464,v1:172.21.15.105:6809/24464] conn(0x7f026c0665e0 0x7f026c0689f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f026c060860 msgr2=0x7f026c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f026c060860 0x7f026c062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02840058d0 tx=0x7f0284009040 comp rx=0 tx=0).stop 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02880b2e90 msgr2=0x7f02880c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 --2- 172.21.15.33:0/2200898575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02880b2e90 0x7f02880c71a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f027c009160 tx=0x7f027c015000 comp rx=0 tx=0).stop 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028ddcf700 1 -- 172.21.15.33:0/2200898575 reap_dead start 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 shutdown_connections 2024-08-15T17:57:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 >> 172.21.15.33:0/2200898575 conn(0x7f0288067590 msgr2=0x7f0288068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 shutdown_connections 2024-08-15T17:57:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.235+0000 7f028e5d0700 1 -- 172.21.15.33:0/2200898575 wait complete. 2024-08-15T17:57:18.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-15T17:57:18.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 Processor -- start 2024-08-15T17:57:18.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 -- start start 2024-08-15T17:57:18.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f868c156fb0 0x7f868c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f868c0cafa0 0x7f868c15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c15ada0 con 0x7f868c15d4e0 2024-08-15T17:57:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0cbce0 con 0x7f868c0cafa0 2024-08-15T17:57:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.359+0000 7f86935db700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c15d920 con 0x7f868c156fb0 2024-08-15T17:57:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f868c0cafa0 0x7f868c15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f868c0cafa0 0x7f868c15cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48330/0 (socket says 172.21.15.33:48330) 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 -- 172.21.15.33:0/1963024800 learned_addr learned my addr 172.21.15.33:0/1963024800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8691377700 1 --2- 172.21.15.33:0/1963024800 >> v2:172.21.15.105:3300/0 conn(0x7f868c156fb0 0x7f868c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 -- 172.21.15.33:0/1963024800 >> v2:172.21.15.105:3300/0 conn(0x7f868c156fb0 msgr2=0x7f868c0caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 --2- 172.21.15.33:0/1963024800 >> v2:172.21.15.105:3300/0 conn(0x7f868c156fb0 0x7f868c0caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 -- 172.21.15.33:0/1963024800 >> v1:172.21.15.105:6789/0 conn(0x7f868c15d4e0 legacy=0x7f868c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 -- 172.21.15.33:0/1963024800 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c157380 con 0x7f868c0cafa0 2024-08-15T17:57:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8690b76700 1 --2- 172.21.15.33:0/1963024800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c15cfa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f868c088c10 tx=0x7f8688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8cba48c404a6d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8683fff700 1 -- 172.21.15.33:0/1963024800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688009e70 con 0x7f868c0cafa0 2024-08-15T17:57:18.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8683fff700 1 -- 172.21.15.33:0/1963024800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868800b860 con 0x7f868c0cafa0 2024-08-15T17:57:18.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f8683fff700 1 -- 172.21.15.33:0/1963024800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868800bc00 con 0x7f868c0cafa0 2024-08-15T17:57:18.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 -- 172.21.15.33:0/1963024800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 msgr2=0x7f868c15cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 --2- 172.21.15.33:0/1963024800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c15cfa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f868c088c10 tx=0x7f8688009250 comp rx=0 tx=0).stop 2024-08-15T17:57:18.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 -- 172.21.15.33:0/1963024800 shutdown_connections 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 --2- 172.21.15.33:0/1963024800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c15cfa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 --2- 172.21.15.33:0/1963024800 >> v2:172.21.15.105:3300/0 conn(0x7f868c156fb0 0x7f868c0caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 -- 172.21.15.33:0/1963024800 >> 172.21.15.33:0/1963024800 conn(0x7f868c099500 msgr2=0x7f868c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 -- 172.21.15.33:0/1963024800 shutdown_connections 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.363+0000 7f86935db700 1 -- 172.21.15.33:0/1963024800 wait complete. 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 Processor -- start 2024-08-15T17:57:18.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 -- start start 2024-08-15T17:57:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868c156fb0 0x7f868c16c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868c15d4e0 0x7f868c16cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c16dba0 con 0x7f868c0cafa0 2024-08-15T17:57:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0ae3d0 con 0x7f868c156fb0 2024-08-15T17:57:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f86935db700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0add90 con 0x7f868c15d4e0 2024-08-15T17:57:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c0ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48334/0 (socket says 172.21.15.33:48334) 2024-08-15T17:57:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 -- 172.21.15.33:0/4181598905 learned_addr learned my addr 172.21.15.33:0/4181598905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8690b76700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868c156fb0 0x7f868c16c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691b78700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868c15d4e0 0x7f868c16cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 -- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868c15d4e0 msgr2=0x7f868c16cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868c15d4e0 0x7f868c16cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 -- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868c156fb0 msgr2=0x7f868c16c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868c156fb0 0x7f868c16c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8691377700 1 -- 172.21.15.33:0/4181598905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880094f0 con 0x7f868c0cafa0 2024-08-15T17:57:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.367+0000 7f8690b76700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868c156fb0 0x7f868c16c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f8691377700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c0ae860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ec80 tx=0x7f867c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00c7f0 con 0x7f868c0cafa0 2024-08-15T17:57:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c00c950 con 0x7f868c0cafa0 2024-08-15T17:57:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c159ff0 con 0x7f868c0cafa0 2024-08-15T17:57:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ccf0 con 0x7f868c0cafa0 2024-08-15T17:57:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c0ae060 con 0x7f868c0cafa0 2024-08-15T17:57:18.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c0645c0 con 0x7f868c0cafa0 2024-08-15T17:57:18.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.371+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f867c013680 con 0x7f868c0cafa0 2024-08-15T17:57:18.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.375+0000 7f86817fa700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8670060860 0x7f8670062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.375+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f867c07cec0 con 0x7f868c0cafa0 2024-08-15T17:57:18.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.375+0000 7f8690b76700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8670060860 0x7f8670062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.375+0000 7f8690b76700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8670060860 0x7f8670062d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f868c088c10 tx=0x7f8688017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.383+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f867c04d5b0 con 0x7f868c0cafa0 2024-08-15T17:57:18.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.547+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f868c0ae510 con 0x7f8670060860 2024-08-15T17:57:18.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.551+0000 7f86817fa700 1 -- 172.21.15.33:0/4181598905 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f868800b9d0 con 0x7f8670060860 2024-08-15T17:57:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8670060860 msgr2=0x7f8670062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8670060860 0x7f8670062d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f868c088c10 tx=0x7f8688017000 comp rx=0 tx=0).stop 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 msgr2=0x7f868c0ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c0ae860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ec80 tx=0x7f867c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 shutdown_connections 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8670060860 0x7f8670062d10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868c156fb0 0x7f868c16c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868c15d4e0 0x7f868c16cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 --2- 172.21.15.33:0/4181598905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cafa0 0x7f868c0ae860 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 >> 172.21.15.33:0/4181598905 conn(0x7f868c099500 msgr2=0x7f868c0cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 shutdown_connections 2024-08-15T17:57:18.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.555+0000 7f86935db700 1 -- 172.21.15.33:0/4181598905 wait complete. 2024-08-15T17:57:18.557 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 7 to deep-scrub 2024-08-15T17:57:18.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:57:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 Processor -- start 2024-08-15T17:57:18.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 -- start start 2024-08-15T17:57:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8664155d20 0x7f86640b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86640ad7c0 0x7f86640aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640af2b0 con 0x7f866406df10 2024-08-15T17:57:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640adc10 con 0x7f86640ad7c0 2024-08-15T17:57:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8663fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640af590 con 0x7f8664155d20 2024-08-15T17:57:18.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f86637fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f866406df10 0x7f86641599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59726/0 (socket says 172.21.15.33:59726) 2024-08-15T17:57:18.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f86627fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86640ad7c0 0x7f86640aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f86637fe700 1 -- 172.21.15.33:0/2077145916 learned_addr learned my addr 172.21.15.33:0/2077145916 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:18.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.671+0000 7f8662ffd700 1 --2- 172.21.15.33:0/2077145916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8664155d20 0x7f86640b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f86627fc700 1 -- 172.21.15.33:0/2077145916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8664155d20 msgr2=0x7f86640b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:18.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f86627fc700 1 --2- 172.21.15.33:0/2077145916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8664155d20 0x7f86640b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f86627fc700 1 -- 172.21.15.33:0/2077145916 >> v1:172.21.15.33:6789/0 conn(0x7f866406df10 legacy=0x7f86641599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f86627fc700 1 -- 172.21.15.33:0/2077145916 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640af870 con 0x7f86640ad7c0 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f86627fc700 1 --2- 172.21.15.33:0/2077145916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640ad7c0 0x7f86640aea80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f86580098e0 tx=0x7f86580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de602f377ffa8122 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8661ffb700 1 -- 172.21.15.33:0/2077145916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800b640 con 0x7f86640ad7c0 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8661ffb700 1 -- 172.21.15.33:0/2077145916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800b7a0 con 0x7f86640ad7c0 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8661ffb700 1 -- 172.21.15.33:0/2077145916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800bb40 con 0x7f86640ad7c0 2024-08-15T17:57:18.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 -- 172.21.15.33:0/2077145916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640ad7c0 msgr2=0x7f86640aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 --2- 172.21.15.33:0/2077145916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640ad7c0 0x7f86640aea80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f86580098e0 tx=0x7f86580091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 -- 172.21.15.33:0/2077145916 shutdown_connections 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 --2- 172.21.15.33:0/2077145916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640ad7c0 0x7f86640aea80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 --2- 172.21.15.33:0/2077145916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8664155d20 0x7f86640b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 -- 172.21.15.33:0/2077145916 >> 172.21.15.33:0/2077145916 conn(0x7f86640678d0 msgr2=0x7f8664067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 -- 172.21.15.33:0/2077145916 shutdown_connections 2024-08-15T17:57:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 -- 172.21.15.33:0/2077145916 wait complete. 2024-08-15T17:57:18.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 Processor -- start 2024-08-15T17:57:18.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.675+0000 7f8663fff700 1 -- start start 2024-08-15T17:57:18.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 0x7f86640a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86640ad7c0 0x7f86640a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8664155d20 0x7f8664166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640a7dd0 con 0x7f866406df10 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640a6ea0 con 0x7f8664155d20 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640a7150 con 0x7f86640ad7c0 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 0x7f86640a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 0x7f86640a6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48338/0 (socket says 172.21.15.33:48338) 2024-08-15T17:57:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 -- 172.21.15.33:0/1275748703 learned_addr learned my addr 172.21.15.33:0/1275748703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f86627fc700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86640ad7c0 0x7f86640a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f86637fe700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8664155d20 0x7f8664166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 -- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86640ad7c0 msgr2=0x7f86640a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86640ad7c0 0x7f86640a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 -- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8664155d20 msgr2=0x7f8664166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8664155d20 0x7f8664166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 -- 172.21.15.33:0/1275748703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009420 con 0x7f866406df10 2024-08-15T17:57:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8662ffd700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 0x7f86640a6420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f865400e930 tx=0x7f86540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654013680 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86540137e0 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640a7430 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654013ba0 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.679+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640a79f0 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.683+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f865400c3e0 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.683+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640643a0 con 0x7f866406df10 2024-08-15T17:57:18.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.683+0000 7f864affd700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8650060860 0x7f8650062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:18.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.683+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f865407c930 con 0x7f866406df10 2024-08-15T17:57:18.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.683+0000 7f86627fc700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8650060860 0x7f8650062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:18.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.683+0000 7f86627fc700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8650060860 0x7f8650062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86580093f0 tx=0x7f8658017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.691+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f865404d020 con 0x7f866406df10 2024-08-15T17:57:18.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.847+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f866406f5f0 con 0x7f8650060860 2024-08-15T17:57:18.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f864affd700 1 -- 172.21.15.33:0/1275748703 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48946 (secure 0 0 0) 0x7f866406f5f0 con 0x7f8650060860 2024-08-15T17:57:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8650060860 msgr2=0x7f8650062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8650060860 0x7f8650062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86580093f0 tx=0x7f8658017000 comp rx=0 tx=0).stop 2024-08-15T17:57:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 msgr2=0x7f86640a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 0x7f86640a6420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f865400e930 tx=0x7f86540091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 shutdown_connections 2024-08-15T17:57:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f8650060860 0x7f8650062d10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8664155d20 0x7f8664166110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86640ad7c0 0x7f86640a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 --2- 172.21.15.33:0/1275748703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f866406df10 0x7f86640a6420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 >> 172.21.15.33:0/1275748703 conn(0x7f86640678d0 msgr2=0x7f8664069430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 shutdown_connections 2024-08-15T17:57:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:18.855+0000 7f8663fff700 1 -- 172.21.15.33:0/1275748703 wait complete. 2024-08-15T17:57:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:57:18.872 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-08-15T17:57:18.318737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392492,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582228,"statfs":{"total":773094113280,"available":770644201472,"internally_reserved":0,"allocated":5414912,"data_stored":2969608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.912435"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":45,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-15T17:57:15.692420+0000","last_change":"2024-08-15T17:57:16.301921+0000","last_active":"2024-08-15T17:57:15.692420+0000","last_peered":"2024-08-15T17:57:15.692420+0000","last_clean":"2024-08-15T17:57:15.692420+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:57:15.692420+0000","last_undegraded":"2024-08-15T17:57:15.692420+0000","last_fullsized":"2024-08-15T17:57:15.692420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-15T17:53:36.800457+0000","last_clean_scrub_stamp":"2024-08-15T17:53:36.800457+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.054,"15min":1.054},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.754},"min":{"1min":0.628,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.61599999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.216,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.0760000000000001,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.754},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.0149999999999999,"15min":1.0589999999999999},"min":{"1min":0.78700000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0740000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.78400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3859999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.76500000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4259999999999999,"5min":1.629,"15min":1.629},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.2390000000000001},"min":{"1min":0.94999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.373,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.133},"min":{"1min":0.874,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3520000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":1.0609999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.401,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2769999999999999,"15min":1.2969999999999999},"min":{"1min":1.0089999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4670000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.256},"min":{"1min":0.90000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.444,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.248},"min":{"1min":1.0309999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4750000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.96099999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.018,"15min":1.018},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.66600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0489999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.71699999999999997},"min":{"1min":0.55600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85899999999999999,"5min":1.409,"15min":1.409},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.028,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.147,"5min":1.218,"15min":1.218},"last":1.254}]},{"osd":4,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":0.995},"min":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2210000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0629999999999999,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.266,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.2130000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.115,"15min":1.147},"min":{"1min":0.872,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4419999999999999,"5min":1.992,"15min":1.992},"last":1.02},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.095,"15min":1.105},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3009999999999999,"5min":1.367,"15min":1.367},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.226,"5min":1.532,"15min":1.532},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.248,"15min":1.284},"min":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1830000000000001,"15min":1.1850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.3300000000000001,"5min":1.446,"15min":1.446},"last":1.294},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.94599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.593,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.391}]}]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.746},"min":{"1min":0.57799999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.497},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.622}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.21,"5min":1.54,"15min":1.54},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.113},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.339,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.748},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.82299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.177,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0800000000000001,"15min":1.107},"min":{"1min":0.755,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2829999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1719999999999999,"15min":1.1839999999999999},"min":{"1min":0.86799999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.365,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.494,"5min":1.829,"15min":1.829},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.242,"15min":1.2849999999999999},"min":{"1min":0.84899999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.46,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.01}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.284,"15min":1.3260000000000001},"min":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5580000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.121},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.212,"15min":1.232},"min":{"1min":1.02,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5600000000000001,"5min":2.109,"15min":2.109},"last":1.3120000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.88100000000000001,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0149999999999999,"15min":1.002},"min":{"1min":0.67500000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.248,"5min":1.377,"15min":1.377},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2589999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.65900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2390000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.872}]},{"osd":2,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.262,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91300000000000003,"15min":0.89900000000000002},"min":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.359,"15min":1.359},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.61799999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.224,"5min":1.389,"15min":1.389},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0660000000000001,"15min":1.073},"min":{"1min":0.71799999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.274,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2050000000000001,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.093},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.71399999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.234,"5min":1.508,"15min":1.508},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.67100000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.3500000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.1279999999999999,"15min":1.1259999999999999},"min":{"1min":0.84799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":1.3129999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.159}]},{"osd":6,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.306,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.046},{"interface":"front","average":{"1min":1.21,"5min":1.2250000000000001,"15min":1.2450000000000001},"min":{"1min":0.90000000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4179999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.127}]}]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.97499999999999998,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.264,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93300000000000005,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.01,"5min":0.89500000000000002,"15min":0.85299999999999998},"min":{"1min":0.66400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92100000000000004,"15min":0.93300000000000005},"min":{"1min":0.71799999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.226,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.008,"15min":1.016},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2929999999999999,"5min":1.694,"15min":1.694},"last":1.016}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0289999999999999},"min":{"1min":0.71899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.71599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":0.98599999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.2929999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1559999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.109,"15min":1.097},"min":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6040000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.345},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.1639999999999999},"min":{"1min":0.98999999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4550000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.157}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2250000000000001,"5min":1.238,"15min":1.238},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.65300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94499999999999995,"15min":0.91300000000000003},"min":{"1min":0.74399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.95599999999999996},"min":{"1min":0.77800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.1020000000000001}]},{"osd":2,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.71099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.181,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92400000000000004,"15min":0.91700000000000004},"min":{"1min":0.66800000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.173,"5min":1.242,"15min":1.242},"last":1.0369999999999999}]},{"osd":3,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.94899999999999995},"min":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2230000000000001,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0169999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1870000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.93899999999999995}]},{"osd":4,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2929999999999999,"5min":1.532,"15min":1.532},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.88500000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.1279999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.72899999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.228},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.103,"15min":1.111},"min":{"1min":0.69799999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.153}]},{"osd":7,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.119,"15min":1.131},"min":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1619999999999999,"15min":1.1819999999999999},"min":{"1min":0.88100000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4570000000000001,"5min":1.595,"15min":1.595},"last":1.431}]}]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.90100000000000002},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.095,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.95599999999999996},"min":{"1min":0.63800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.95199999999999996,"15min":0.92600000000000005},"min":{"1min":0.84499999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.63},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.996,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.363,"5min":1.659,"15min":1.659},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98399999999999999,"15min":0.97799999999999998},"min":{"1min":0.68899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.034,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.091,"15min":1.117},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.605,"15min":1.605},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0189999999999999,"15min":1.0349999999999999},"min":{"1min":0.76100000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.425,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.006,"15min":1.0229999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1819999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6839999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.139},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.466,"5min":1.544,"15min":1.544},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1919999999999999,"15min":1.216},"min":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.5,"5min":1.671,"15min":1.671},"last":1.056},{"interface":"front","average":{"1min":1.24,"5min":1.272,"15min":1.28},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.639,"5min":1.758,"15min":1.758},"last":1.0189999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72799999999999998,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.628},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.70799999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.752}]},{"osd":3,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.64600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":1.276,"15min":1.276},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5860000000000001,"5min":2.355,"15min":2.355},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.179,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.91700000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":1.087}]},{"osd":5,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.173,"15min":1.175},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.399,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4039999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.292}]},{"osd":6,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.583,"5min":1.774,"15min":1.774},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2569999999999999,"15min":1.2529999999999999},"min":{"1min":1.0740000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.4590000000000001,"5min":1.645,"15min":1.645},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.232,"15min":1.234},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.506,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":1.0489999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:57:18.877 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-15T17:53:36.800457+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=15, tm_hour=17, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=228, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=15, tm_hour=17, tm_min=57, tm_sec=13, tm_wday=3, tm_yday=228, tm_isdst=0) 2024-08-15T17:57:18.877 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-15T17:57:23.454 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:57:23.457 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:57:38.878 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-15T17:57:39.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 Processor -- start 2024-08-15T17:57:39.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 -- start start 2024-08-15T17:57:39.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c154900 0x7f227c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f227c0b12d0 0x7f227c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f227c0cb390 0x7f227c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c068790 con 0x7f227c0cb390 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c1583f0 con 0x7f227c0b12d0 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0cbaa0 con 0x7f227c154900 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f227c0cb390 0x7f227c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f227c0cb390 0x7f227c06df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46500/0 (socket says 172.21.15.33:46500) 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 -- 172.21.15.33:0/3005682849 learned_addr learned my addr 172.21.15.33:0/3005682849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227a7fc700 1 --2- 172.21.15.33:0/3005682849 >> v2:172.21.15.105:3300/0 conn(0x7f227c0b12d0 0x7f227c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227affd700 1 --2- 172.21.15.33:0/3005682849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c154900 0x7f227c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 -- 172.21.15.33:0/3005682849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c154900 msgr2=0x7f227c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 --2- 172.21.15.33:0/3005682849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c154900 0x7f227c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 -- 172.21.15.33:0/3005682849 >> v2:172.21.15.105:3300/0 conn(0x7f227c0b12d0 msgr2=0x7f227c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 --2- 172.21.15.33:0/3005682849 >> v2:172.21.15.105:3300/0 conn(0x7f227c0b12d0 0x7f227c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:38.999+0000 7f227b7fe700 1 -- 172.21.15.33:0/3005682849 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0b1700 con 0x7f227c0cb390 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227a7fc700 1 --2- 172.21.15.33:0/3005682849 >> v2:172.21.15.105:3300/0 conn(0x7f227c0b12d0 0x7f227c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227b7fe700 1 --2- 172.21.15.33:0/3005682849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c0cb390 0x7f227c06df10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f227c070d00 tx=0x7f2274009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529c9d7985dc0cf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f2279ffb700 1 -- 172.21.15.33:0/3005682849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400e070 con 0x7f227c0cb390 2024-08-15T17:57:39.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f2279ffb700 1 -- 172.21.15.33:0/3005682849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400ba50 con 0x7f227c0cb390 2024-08-15T17:57:39.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f2279ffb700 1 -- 172.21.15.33:0/3005682849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740092e0 con 0x7f227c0cb390 2024-08-15T17:57:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 -- 172.21.15.33:0/3005682849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c0cb390 msgr2=0x7f227c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 --2- 172.21.15.33:0/3005682849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c0cb390 0x7f227c06df10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f227c070d00 tx=0x7f2274009840 comp rx=0 tx=0).stop 2024-08-15T17:57:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 -- 172.21.15.33:0/3005682849 shutdown_connections 2024-08-15T17:57:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 --2- 172.21.15.33:0/3005682849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c0cb390 0x7f227c06df10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 --2- 172.21.15.33:0/3005682849 >> v2:172.21.15.105:3300/0 conn(0x7f227c0b12d0 0x7f227c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 --2- 172.21.15.33:0/3005682849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c154900 0x7f227c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 -- 172.21.15.33:0/3005682849 >> 172.21.15.33:0/3005682849 conn(0x7f227c0678d0 msgr2=0x7f227c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:39.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 -- 172.21.15.33:0/3005682849 shutdown_connections 2024-08-15T17:57:39.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.003+0000 7f227bfff700 1 -- 172.21.15.33:0/3005682849 wait complete. 2024-08-15T17:57:39.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 Processor -- start 2024-08-15T17:57:39.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 -- start start 2024-08-15T17:57:39.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227c0b12d0 0x7f227c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c0cb390 0x7f227c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 0x7f227c15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15a7c0 con 0x7f227c154900 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15bf90 con 0x7f227c0b12d0 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15c270 con 0x7f227c0cb390 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 0x7f227c15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 0x7f227c15b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46502/0 (socket says 172.21.15.33:46502) 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 -- 172.21.15.33:0/2053543904 learned_addr learned my addr 172.21.15.33:0/2053543904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227a7fc700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c0cb390 0x7f227c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227affd700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227c0b12d0 0x7f227c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 -- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c0cb390 msgr2=0x7f227c15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c0cb390 0x7f227c15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 -- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227c0b12d0 msgr2=0x7f227c150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227c0b12d0 0x7f227c150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 -- 172.21.15.33:0/2053543904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009ae0 con 0x7f227c154900 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227affd700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227c0b12d0 0x7f227c150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227b7fe700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 0x7f227c15b910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f227c06c2d0 tx=0x7f2274018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740032f0 con 0x7f227c154900 2024-08-15T17:57:39.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274008d90 con 0x7f227c154900 2024-08-15T17:57:39.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c15c550 con 0x7f227c154900 2024-08-15T17:57:39.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274026690 con 0x7f227c154900 2024-08-15T17:57:39.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.007+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c166c10 con 0x7f227c154900 2024-08-15T17:57:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.011+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0643a0 con 0x7f227c154900 2024-08-15T17:57:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.011+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2274003040 con 0x7f227c154900 2024-08-15T17:57:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.011+0000 7f2272ffd700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f225c060860 0x7f225c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.011+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f227407ea20 con 0x7f227c154900 2024-08-15T17:57:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.011+0000 7f227affd700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f225c060860 0x7f225c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.015+0000 7f227affd700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f225c060860 0x7f225c062d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f226c006fd0 tx=0x7f226c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.019+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f227404f070 con 0x7f227c154900 2024-08-15T17:57:39.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.183+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 --> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f227c15ca50 con 0x7f225c060860 2024-08-15T17:57:39.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.187+0000 7f2272ffd700 1 -- 172.21.15.33:0/2053543904 <== mgr.4105 v2:172.21.15.105:6832/24094 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48953 (secure 0 0 0) 0x7f226c00f790 con 0x7f225c060860 2024-08-15T17:57:39.190 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f225c060860 msgr2=0x7f225c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f225c060860 0x7f225c062d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f226c006fd0 tx=0x7f226c008040 comp rx=0 tx=0).stop 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 msgr2=0x7f227c15b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 0x7f227c15b910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f227c06c2d0 tx=0x7f2274018000 comp rx=0 tx=0).stop 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 shutdown_connections 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7f225c060860 0x7f225c062d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f227c154900 0x7f227c15b910 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f227c0cb390 0x7f227c15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 --2- 172.21.15.33:0/2053543904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227c0b12d0 0x7f227c150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 >> 172.21.15.33:0/2053543904 conn(0x7f227c0678d0 msgr2=0x7f227c0aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:39.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 shutdown_connections 2024-08-15T17:57:39.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.191+0000 7f227bfff700 1 -- 172.21.15.33:0/2053543904 wait complete. 2024-08-15T17:57:39.196 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-15T17:57:39.210 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-15T17:57:38.324316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392476,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582244,"statfs":{"total":773094113280,"available":770644217856,"internally_reserved":0,"allocated":5414912,"data_stored":2969608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003329"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":198,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-15T17:57:16.311189+0000","last_change":"2024-08-15T17:57:16.311141+0000","last_active":"2024-08-15T17:57:16.311189+0000","last_peered":"2024-08-15T17:57:16.311189+0000","last_clean":"2024-08-15T17:57:16.311189+0000","last_became_active":"2024-08-15T17:53:37.820714+0000","last_became_peered":"2024-08-15T17:53:37.820714+0000","last_unstale":"2024-08-15T17:57:16.311189+0000","last_undegraded":"2024-08-15T17:57:16.311189+0000","last_fullsized":"2024-08-15T17:57:16.311189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2024-08-15T17:57:16.311003+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2024-08-15T17:57:16.311003+0000","last_clean_scrub_stamp":"2024-08-15T17:57:16.311003+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-16T22:27:52.465069+0000","scrub_duration":0.0087843139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.054,"15min":1.054},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.754},"min":{"1min":0.628,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.753}]},{"osd":1,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.61599999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.216,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.0760000000000001,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.0149999999999999,"15min":1.0589999999999999},"min":{"1min":0.78700000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0740000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.0109999999999999}]},{"osd":4,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.78400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3859999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0880000000000001,"15min":1.1020000000000001},"min":{"1min":0.76500000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4259999999999999,"5min":1.629,"15min":1.629},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.2390000000000001},"min":{"1min":0.94999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.373,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.133},"min":{"1min":0.874,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3520000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.234}]},{"osd":6,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":1.0609999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.401,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2769999999999999,"15min":1.2969999999999999},"min":{"1min":1.0089999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4670000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.2090000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.256},"min":{"1min":0.90000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.444,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.248},"min":{"1min":1.0309999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4750000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.282}]}]},{"osd":2,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.018,"15min":1.018},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.66600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0489999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.71699999999999997},"min":{"1min":0.55600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85899999999999999,"5min":1.409,"15min":1.409},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.028,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.147,"5min":1.218,"15min":1.218},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":0.995},"min":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2210000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.0629999999999999,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.266,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.024}]},{"osd":5,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.115,"15min":1.147},"min":{"1min":0.872,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4419999999999999,"5min":1.992,"15min":1.992},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.095,"15min":1.105},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3009999999999999,"5min":1.367,"15min":1.367},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.226,"5min":1.532,"15min":1.532},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.248,"15min":1.284},"min":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:56:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1830000000000001,"15min":1.1850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.3300000000000001,"5min":1.446,"15min":1.446},"last":1.131},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.94599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.593,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2310000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.746},"min":{"1min":0.57799999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.21,"5min":1.54,"15min":1.54},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.113},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.339,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.82299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.177,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.048}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0800000000000001,"15min":1.107},"min":{"1min":0.755,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2829999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.153},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1719999999999999,"15min":1.1839999999999999},"min":{"1min":0.86799999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.365,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.494,"5min":1.829,"15min":1.829},"last":1.014},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.242,"15min":1.2849999999999999},"min":{"1min":0.84899999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.46,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.284,"15min":1.3260000000000001},"min":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5580000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.288},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.212,"15min":1.232},"min":{"1min":1.02,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5600000000000001,"5min":2.109,"15min":2.109},"last":1.306}]}]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.88100000000000001,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.006},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0149999999999999,"15min":1.002},"min":{"1min":0.67500000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.248,"5min":1.377,"15min":1.377},"last":1.036}]},{"osd":1,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2589999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.65900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2390000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.262,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91300000000000003,"15min":0.89900000000000002},"min":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.359,"15min":1.359},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Aug 15 17:56:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.61799999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.224,"5min":1.389,"15min":1.389},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0660000000000001,"15min":1.073},"min":{"1min":0.71799999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.274,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.147}]},{"osd":4,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2050000000000001,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.71399999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.234,"5min":1.508,"15min":1.508},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.67100000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.3500000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.123},{"interface":"front","average":{"1min":1.121,"5min":1.1279999999999999,"15min":1.1259999999999999},"min":{"1min":0.84799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":1.3129999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.206}]},{"osd":6,"last update":"Thu Aug 15 17:56:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.306,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2250000000000001,"15min":1.2450000000000001},"min":{"1min":0.90000000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4179999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.1830000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.97499999999999998,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.264,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.024},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93300000000000005,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.01,"5min":0.89500000000000002,"15min":0.85299999999999998},"min":{"1min":0.66400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92100000000000004,"15min":0.93300000000000005},"min":{"1min":0.71799999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.226,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.008,"15min":1.016},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2929999999999999,"5min":1.694,"15min":1.694},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0289999999999999},"min":{"1min":0.71899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.873},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.71599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":0.98599999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1559999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.097}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.109,"15min":1.097},"min":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6040000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.1639999999999999},"min":{"1min":0.98999999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4550000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1719999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2250000000000001,"5min":1.238,"15min":1.238},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.65300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94499999999999995,"15min":0.91300000000000003},"min":{"1min":0.74399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.95599999999999996},"min":{"1min":0.77800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.71099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.181,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92400000000000004,"15min":0.91700000000000004},"min":{"1min":0.66800000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.173,"5min":1.242,"15min":1.242},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.94899999999999995},"min":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2230000000000001,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0169999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1870000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2929999999999999,"5min":1.532,"15min":1.532},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.88500000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.26}]},{"osd":6,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.72899999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.103,"15min":1.111},"min":{"1min":0.69799999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.097}]},{"osd":7,"last update":"Thu Aug 15 17:56:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.119,"15min":1.131},"min":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1619999999999999,"15min":1.1819999999999999},"min":{"1min":0.88100000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4570000000000001,"5min":1.595,"15min":1.595},"last":1.0649999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":528384,"data_stored":223609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.90100000000000002},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.095,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.95599999999999996},"min":{"1min":0.63800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.95199999999999996,"15min":0.92600000000000005},"min":{"1min":0.84499999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.105},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.996,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.363,"5min":1.659,"15min":1.659},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98399999999999999,"15min":0.97799999999999998},"min":{"1min":0.68899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.034,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.091,"15min":1.117},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.605,"15min":1.605},"last":1.054},{"interface":"front","average":{"1min":1.008,"5min":1.0189999999999999,"15min":1.0349999999999999},"min":{"1min":0.76100000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.425,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.006,"15min":1.0229999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":1.393,"15min":1.393},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.875}]},{"osd":6,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1819999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6839999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.139},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.466,"5min":1.544,"15min":1.544},"last":1.077}]},{"osd":7,"last update":"Thu Aug 15 17:56:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1919999999999999,"15min":1.216},"min":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.5,"5min":1.671,"15min":1.671},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.272,"15min":1.28},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.639,"5min":1.758,"15min":1.758},"last":1.1779999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302608,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069232,"statfs":{"total":96636764160,"available":96326893568,"internally_reserved":0,"allocated":1122304,"data_stored":813977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1519999999999999,"5min":1.224,"15min":1.224},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72799999999999998,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.70799999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Aug 15 17:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.64600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":1.276,"15min":1.276},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93799999999999994}]},{"osd":4,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5860000000000001,"5min":2.355,"15min":2.355},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.179,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.91700000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.173,"15min":1.175},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.399,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3},{"interface":"front","average":{"1min":1.097,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4039999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.04}]},{"osd":6,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91100000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.583,"5min":1.774,"15min":1.774},"last":1.137},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2569999999999999,"15min":1.2529999999999999},"min":{"1min":1.0740000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.4590000000000001,"5min":1.645,"15min":1.645},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Aug 15 17:56:42 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.232,"15min":1.234},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.506,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.254},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":1.0489999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-15T17:57:39.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-15T17:57:39.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 Processor -- start 2024-08-15T17:57:39.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 -- start start 2024-08-15T17:57:39.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5641591e0 0x7fb5640ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5640ced10 0x7fb5640cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640cf1c0 con 0x7fb5640cceb0 2024-08-15T17:57:39.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640cf460 con 0x7fb5641591e0 2024-08-15T17:57:39.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56922c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640cf700 con 0x7fb5640ced10 2024-08-15T17:57:39.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56359e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb5640cceb0 0x7fb5640cade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49750/0 (socket says 172.21.15.33:49750) 2024-08-15T17:57:39.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb562d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5641591e0 0x7fb5640ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56359e700 1 -- 172.21.15.33:0/3674658431 learned_addr learned my addr 172.21.15.33:0/3674658431 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:39.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb56259c700 1 --2- 172.21.15.33:0/3674658431 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5640ced10 0x7fb5640cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb562d9d700 1 -- 172.21.15.33:0/3674658431 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5640ced10 msgr2=0x7fb5640cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:39.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb562d9d700 1 --2- 172.21.15.33:0/3674658431 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5640ced10 0x7fb5640cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb562d9d700 1 -- 172.21.15.33:0/3674658431 >> v1:172.21.15.33:6789/0 conn(0x7fb5640cceb0 legacy=0x7fb5640cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.319+0000 7fb562d9d700 1 -- 172.21.15.33:0/3674658431 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640cd330 con 0x7fb5641591e0 2024-08-15T17:57:39.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb562d9d700 1 --2- 172.21.15.33:0/3674658431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5641591e0 0x7fb5640ce7d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0098e0 tx=0x7fb54c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd046685e3fa824 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb561d9b700 1 -- 172.21.15.33:0/3674658431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00b640 con 0x7fb5641591e0 2024-08-15T17:57:39.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb561d9b700 1 -- 172.21.15.33:0/3674658431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00b7a0 con 0x7fb5641591e0 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb561d9b700 1 -- 172.21.15.33:0/3674658431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00bb40 con 0x7fb5641591e0 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 -- 172.21.15.33:0/3674658431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5641591e0 msgr2=0x7fb5640ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 --2- 172.21.15.33:0/3674658431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5641591e0 0x7fb5640ce7d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0098e0 tx=0x7fb54c0091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 -- 172.21.15.33:0/3674658431 shutdown_connections 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 --2- 172.21.15.33:0/3674658431 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5640ced10 0x7fb5640cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 --2- 172.21.15.33:0/3674658431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5641591e0 0x7fb5640ce7d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 -- 172.21.15.33:0/3674658431 >> 172.21.15.33:0/3674658431 conn(0x7fb564089bc0 msgr2=0x7fb5640994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:39.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 -- 172.21.15.33:0/3674658431 shutdown_connections 2024-08-15T17:57:39.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 -- 172.21.15.33:0/3674658431 wait complete. 2024-08-15T17:57:39.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 Processor -- start 2024-08-15T17:57:39.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.323+0000 7fb56922c700 1 -- start start 2024-08-15T17:57:39.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5640cceb0 0x7fb56416a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 0x7fb5641690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5641591e0 0x7fb5640ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56416c4e0 con 0x7fb5640ced10 2024-08-15T17:57:39.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56409c240 con 0x7fb5640cceb0 2024-08-15T17:57:39.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb564169980 con 0x7fb5641591e0 2024-08-15T17:57:39.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 0x7fb5641690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 0x7fb5641690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46522/0 (socket says 172.21.15.33:46522) 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 -- 172.21.15.33:0/1337377924 learned_addr learned my addr 172.21.15.33:0/1337377924 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb562d9d700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5640cceb0 0x7fb56416a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56359e700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5641591e0 0x7fb5640ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 -- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5641591e0 msgr2=0x7fb5640ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5641591e0 0x7fb5640ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 -- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5640cceb0 msgr2=0x7fb56416a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5640cceb0 0x7fb56416a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 -- 172.21.15.33:0/1337377924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009420 con 0x7fb5640ced10 2024-08-15T17:57:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb562d9d700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5640cceb0 0x7fb56416a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-15T17:57:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56259c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 0x7fb5641690c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb55400ec80 tx=0x7fb5540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400c9d0 con 0x7fb5640ced10 2024-08-15T17:57:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55400cb30 con 0x7fb5640ced10 2024-08-15T17:57:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb564169c60 con 0x7fb5640ced10 2024-08-15T17:57:39.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554013470 con 0x7fb5640ced10 2024-08-15T17:57:39.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.327+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56409bed0 con 0x7fb5640ced10 2024-08-15T17:57:39.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.331+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56409c3f0 con 0x7fb5640ced10 2024-08-15T17:57:39.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.331+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb554013820 con 0x7fb5640ced10 2024-08-15T17:57:39.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.331+0000 7fb55affd700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb544060860 0x7fb544062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.331+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb55407cc50 con 0x7fb5640ced10 2024-08-15T17:57:39.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.331+0000 7fb562d9d700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb544060860 0x7fb544062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.335+0000 7fb562d9d700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb544060860 0x7fb544062d10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0093f0 tx=0x7fb54c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.339+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb56409c3f0 con 0x7fb5640ced10 2024-08-15T17:57:39.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.503+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb56409c3b0 con 0x7fb5640ced10 2024-08-15T17:57:39.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.507+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb55404d340 con 0x7fb5640ced10 2024-08-15T17:57:39.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.507+0000 7fb55affd700 1 -- 172.21.15.33:0/1337377924 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb554082020 con 0x7fb5640ced10 2024-08-15T17:57:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb544060860 msgr2=0x7fb544062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb544060860 0x7fb544062d10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0093f0 tx=0x7fb54c017000 comp rx=0 tx=0).stop 2024-08-15T17:57:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 msgr2=0x7fb5641690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 0x7fb5641690c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb55400ec80 tx=0x7fb5540091a0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 shutdown_connections 2024-08-15T17:57:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7fb544060860 0x7fb544062d10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5641591e0 0x7fb5640ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5640ced10 0x7fb5641690c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 --2- 172.21.15.33:0/1337377924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5640cceb0 0x7fb56416a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 >> 172.21.15.33:0/1337377924 conn(0x7fb564089bc0 msgr2=0x7fb5641571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 shutdown_connections 2024-08-15T17:57:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.511+0000 7fb56922c700 1 -- 172.21.15.33:0/1337377924 wait complete. 2024-08-15T17:57:39.527 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-15T17:57:39.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-15T17:57:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99e310700 1 Processor -- start 2024-08-15T17:57:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99e310700 1 -- start start 2024-08-15T17:57:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99e310700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 0x7ff998168440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99e310700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980b3da0 con 0x7ff9980c1140 2024-08-15T17:57:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99e310700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980ca2f0 con 0x7ff9980c1510 2024-08-15T17:57:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99e310700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b3190 con 0x7ff9980c9c20 2024-08-15T17:57:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99d30e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff9980c1140 0x7ff9980b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49762/0 (socket says 172.21.15.33:49762) 2024-08-15T17:57:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99d30e700 1 -- 172.21.15.33:0/2798364346 learned_addr learned my addr 172.21.15.33:0/2798364346 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-08-15T17:57:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 0x7ff998168440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430799382 0 0) 0x7ff9980b3da0 con 0x7ff9980c1140 2024-08-15T17:57:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984003570 con 0x7ff9980c1140 2024-08-15T17:57:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2561238844 0 0) 0x7ff984003570 con 0x7ff9980c1140 2024-08-15T17:57:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 msgr2=0x7ff998168440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 0x7ff998168440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 >> v1:172.21.15.105:6789/0 conn(0x7ff9980c1510 legacy=0x7ff9980c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980b3470 con 0x7ff9980c1140 2024-08-15T17:57:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3735786283 0 0) 0x7ff98c001470 con 0x7ff9980c1140 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 >> v1:172.21.15.33:6789/0 conn(0x7ff9980c1140 legacy=0x7ff9980b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 0x7ff984003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff984003fd0 0x7ff984004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff984004d50 0x7ff9840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b3190 con 0x7ff984004d50 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98400bb40 con 0x7ff984003fd0 2024-08-15T17:57:39.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98400bd00 con 0x7ff9980c9c20 2024-08-15T17:57:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff984004d50 0x7ff9840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99d30e700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 0x7ff984003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99cb0d700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff984003fd0 0x7ff984004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 -- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 msgr2=0x7ff984003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980c9c20 0x7ff984003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 -- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff984003fd0 msgr2=0x7ff984004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff984003fd0 0x7ff984004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 -- 172.21.15.33:0/2798364346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984003570 con 0x7ff984004d50 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff99db0f700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff984004d50 0x7ff9840051c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff9980c4f20 tx=0x7ff99000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96c9238c8388cee server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000ea60 con 0x7ff984004d50 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff99000f040 con 0x7ff984004d50 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.631+0000 7ff98bfff700 1 -- 172.21.15.33:0/2798364346 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000ee30 con 0x7ff984004d50 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2798364346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff984004d50 msgr2=0x7ff9840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 --2- 172.21.15.33:0/2798364346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff984004d50 0x7ff9840051c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff9980c4f20 tx=0x7ff99000b040 comp rx=0 tx=0).stop 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99db0f700 1 -- 172.21.15.33:0/2798364346 reap_dead start 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2798364346 shutdown_connections 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2798364346 >> 172.21.15.33:0/2798364346 conn(0x7ff9980ca930 msgr2=0x7ff9980cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2798364346 shutdown_connections 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2798364346 wait complete. 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 Processor -- start 2024-08-15T17:57:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- start start 2024-08-15T17:57:39.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 0x7ff9980c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9980c38d0 0x7ff99806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99806b0a0 0x7ff998068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99806c600 con 0x7ff9980c0290 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99806b9f0 con 0x7ff9980c38d0 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99806bcd0 con 0x7ff99806b0a0 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 0x7ff9980c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 0x7ff9980c0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46534/0 (socket says 172.21.15.33:46534) 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 -- 172.21.15.33:0/2124261169 learned_addr learned my addr 172.21.15.33:0/2124261169 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99cb0d700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9980c38d0 0x7ff99806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99db0f700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99806b0a0 0x7ff998068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 -- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99806b0a0 msgr2=0x7ff998068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99806b0a0 0x7ff998068770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 -- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9980c38d0 msgr2=0x7ff99806ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9980c38d0 0x7ff99806ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 -- 172.21.15.33:0/2124261169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99806bfb0 con 0x7ff9980c0290 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99d30e700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 0x7ff9980c0660 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e830 tx=0x7ff98c000f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00a580 con 0x7ff9980c0290 2024-08-15T17:57:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff98c010040 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99806c290 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00a950 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.635+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99806b4f0 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.639+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99806b770 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.639+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff98c013390 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.639+0000 7ff9897fa700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff97c060890 0x7ff97c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.639+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff98c07bd80 con 0x7ff9980c0290 2024-08-15T17:57:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.639+0000 7ff99cb0d700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff97c060890 0x7ff97c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-15T17:57:39.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.643+0000 7ff99cb0d700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff97c060890 0x7ff97c062d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff99815de20 tx=0x7ff994009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-15T17:57:39.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.651+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff98c04c4f0 con 0x7ff9980c0290 2024-08-15T17:57:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.851+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9980638f0 con 0x7ff9980c0290 2024-08-15T17:57:39.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.851+0000 7ff9897fa700 1 -- 172.21.15.33:0/2124261169 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3529 (secure 0 0 0) 0x7ff98c019070 con 0x7ff9980c0290 2024-08-15T17:57:39.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-15T17:57:39.855 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/231285007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":231285007},{"type":"v1","addr":"172.21.15.33:6833","nonce":231285007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/803257020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":803257020},{"type":"v1","addr":"172.21.15.33:6835","nonce":803257020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3680521485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3680521485},{"type":"v1","addr":"172.21.15.105:6837","nonce":3680521485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2948096824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2948096824},{"type":"v1","addr":"172.21.15.105:6836","nonce":2948096824}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff97c060890 msgr2=0x7ff97c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff97c060890 0x7ff97c062d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff99815de20 tx=0x7ff994009040 comp rx=0 tx=0).stop 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 msgr2=0x7ff9980c0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 0x7ff9980c0660 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e830 tx=0x7ff98c000f90 comp rx=0 tx=0).stop 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 shutdown_connections 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:6832/24094,v1:172.21.15.105:6833/24094] conn(0x7ff97c060890 0x7ff97c062d40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9980c38d0 0x7ff99806ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99806b0a0 0x7ff998068770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 --2- 172.21.15.33:0/2124261169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9980c0290 0x7ff9980c0660 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-15T17:57:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 >> 172.21.15.33:0/2124261169 conn(0x7ff9980ca930 msgr2=0x7ff9981601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-15T17:57:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 shutdown_connections 2024-08-15T17:57:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-15T17:57:39.855+0000 7ff99e310700 1 -- 172.21.15.33:0/2124261169 wait complete. 2024-08-15T17:57:39.859 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 21 2024-08-15T17:57:39.869 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-15T17:57:39.869 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-15T17:57:39.870 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-15T17:57:39.870 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:39.880 INFO:tasks.ceph.mds.a:Stopped 2024-08-15T17:57:39.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-15T17:57:39.881 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:39.894 INFO:tasks.ceph.mds.c:Stopped 2024-08-15T17:57:39.894 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-15T17:57:39.895 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:39.911 INFO:tasks.ceph.mds.b:Stopped 2024-08-15T17:57:39.912 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-15T17:57:39.912 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:39.968 INFO:tasks.ceph.mds.d:Stopped 2024-08-15T17:57:39.968 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-15T17:57:39.968 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-15T17:57:39.968 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.036 INFO:tasks.ceph.osd.0:Stopped 2024-08-15T17:57:40.037 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-15T17:57:40.037 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.133 INFO:tasks.ceph.osd.1:Stopped 2024-08-15T17:57:40.133 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-15T17:57:40.133 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.213 INFO:tasks.ceph.osd.2:Stopped 2024-08-15T17:57:40.213 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-15T17:57:40.214 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.299 INFO:tasks.ceph.osd.3:Stopped 2024-08-15T17:57:40.299 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-15T17:57:40.299 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.369 INFO:tasks.ceph.osd.4:Stopped 2024-08-15T17:57:40.369 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-15T17:57:40.370 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.449 INFO:tasks.ceph.osd.5:Stopped 2024-08-15T17:57:40.449 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-15T17:57:40.449 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.529 INFO:tasks.ceph.osd.6:Stopped 2024-08-15T17:57:40.529 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-15T17:57:40.529 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.596 INFO:tasks.ceph.osd.7:Stopped 2024-08-15T17:57:40.596 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-15T17:57:40.597 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-15T17:57:40.597 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.627 INFO:tasks.ceph.mgr.y:Stopped 2024-08-15T17:57:40.628 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-15T17:57:40.628 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.663 INFO:tasks.ceph.mgr.x:Stopped 2024-08-15T17:57:40.663 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-15T17:57:40.663 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-15T17:57:40.663 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.692 INFO:tasks.ceph.mon.a:Stopped 2024-08-15T17:57:40.692 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-15T17:57:40.692 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.711 INFO:tasks.ceph.mon.b:Stopped 2024-08-15T17:57:40.711 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-15T17:57:40.711 INFO:teuthology.orchestra.run:waiting for 300 2024-08-15T17:57:40.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-08-15T17:57:40.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-08-15T17:57:40.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-08-15T17:57:40.772 INFO:tasks.ceph.mon.c:Stopped 2024-08-15T17:57:40.772 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-15T17:57:40.772 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-15T17:57:40.795 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:57:40.796 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-15T17:57:41.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:57:41.219 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-15T17:57:41.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:57:41.448 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-15T17:57:41.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:57:41.622 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-15T17:57:41.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:57:41.838 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-15T17:57:42.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:57:42.181 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-15T17:57:42.379 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:57:42.379 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-15T17:57:42.602 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:57:42.603 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-15T17:57:42.779 INFO:tasks.ceph:Archiving mon data... 2024-08-15T17:57:42.781 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/data/mon.a.tgz 2024-08-15T17:57:42.781 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-08-15T17:57:42.788 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.z1XAniXnQF 2024-08-15T17:57:42.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.z1XAniXnQF 2024-08-15T17:57:42.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.z1XAniXnQF 2024-08-15T17:57:42.900 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.z1XAniXnQF is 312KB 2024-08-15T17:57:42.961 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.z1XAniXnQF 2024-08-15T17:57:42.968 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/data/mon.b.tgz 2024-08-15T17:57:42.968 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-08-15T17:57:42.975 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.6sS16DbYnm 2024-08-15T17:57:42.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6sS16DbYnm 2024-08-15T17:57:43.074 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.6sS16DbYnm 2024-08-15T17:57:43.102 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.6sS16DbYnm is 414KB 2024-08-15T17:57:43.167 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.6sS16DbYnm 2024-08-15T17:57:43.175 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/data/mon.c.tgz 2024-08-15T17:57:43.175 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-08-15T17:57:43.181 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.eMOSjNEwyC 2024-08-15T17:57:43.181 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eMOSjNEwyC 2024-08-15T17:57:43.281 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.eMOSjNEwyC 2024-08-15T17:57:43.308 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.eMOSjNEwyC is 414KB 2024-08-15T17:57:43.367 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.eMOSjNEwyC 2024-08-15T17:57:43.374 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-15T17:57:43.374 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-15T17:57:43.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-15T17:57:43.393 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-15T17:57:43.393 DEBUG:teuthology.orchestra.run.smithi033:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-15T17:57:43.396 DEBUG:teuthology.orchestra.run.smithi105:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-15T17:57:43.421 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-15T17:57:43.462 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-15T17:57:43.468 INFO:tasks.ceph:Archiving crash dumps... 2024-08-15T17:57:43.470 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/remote/smithi033/crash 2024-08-15T17:57:43.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-15T17:57:43.489 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/remote/smithi105/crash 2024-08-15T17:57:43.490 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-15T17:57:43.507 INFO:tasks.ceph:Shutting down logrotate 2024-08-15T17:57:43.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:57:43.510 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-15T17:57:43.557 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-15T17:57:43.721 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-15T17:57:43.737 INFO:tasks.ceph:Compressing logs... 2024-08-15T17:57:43.738 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-15T17:57:43.740 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-15T17:57:43.762 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30065.log 2024-08-15T17:57:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24179.log 2024-08-15T17:57:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31912.log 2024-08-15T17:57:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30065.log: /var/log/ceph/ceph-client.admin.24179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30532.log 2024-08-15T17:57:43.763 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.24179.log.gz 2024-08-15T17:57:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-08-15T17:57:43.765 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30065.log.gz 2024-08-15T17:57:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-08-15T17:57:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30532.log: /var/log/ceph/ceph-client.admin.33052.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-08-15T17:57:43.766 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31912.log.gz 2024-08-15T17:57:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.32281.log 2024-08-15T17:57:43.766 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30532.log.gz 2024-08-15T17:57:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34904.log 2024-08-15T17:57:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-15T17:57:43.770 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24309.log 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24231.log 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.24309.log: /var/log/ceph/ceph-client.admin.24231.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24231.log.gz 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24309.log.gz 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-15T17:57:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-15T17:57:43.772 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.30012.log 2024-08-15T17:57:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.audit.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-15T17:57:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-15T17:57:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.3.30012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29898.log 2024-08-15T17:57:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.6.log: 88.9% -- replaced with /var/log/ceph/ceph-client.3.30012.log.gz 2024-08-15T17:57:43.776 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-15T17:57:43.780 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.29898.log: 89.5% -- replaced with /var/log/ceph/ceph-client.1.29898.log.gz 2024-08-15T17:57:43.780 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24256.log 2024-08-15T17:57:43.783 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-08-15T17:57:43.783 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32281.log: /var/log/ceph/ceph-client.admin.34904.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34904.log.gz 2024-08-15T17:57:43.783 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2024-08-15T17:57:43.783 INFO:teuthology.orchestra.run.smithi033.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-08-15T17:57:43.783 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32281.log.gz 2024-08-15T17:57:43.783 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33536.log 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31528.log 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34456.log: /var/log/ceph/ceph-client.admin.33536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29361.log 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31528.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33536.log.gz 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34985.log 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31528.log.gz 2024-08-15T17:57:43.784 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30109.log 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29361.log: /var/log/ceph/ceph-client.admin.34985.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34985.log.gz 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29361.log.gz 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34024.log 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30109.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30109.log.gz 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32998.log 2024-08-15T17:57:43.785 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34024.log.gz 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30117.log 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32998.log: /var/log/ceph/ceph-client.admin.30117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34105.log 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32998.log.gz 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30117.log.gz 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30875.log 2024-08-15T17:57:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34105.log: /var/log/ceph/ceph-client.admin.32695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33916.log 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34105.log.gz 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29903.log 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30875.log.gz 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33916.log.gz 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30983.log 2024-08-15T17:57:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29903.log.gz 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32132.log 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30983.log: gzip /var/log/ceph/ceph-client.admin.34769.log: -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30983.log.gz 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-08-15T17:57:43.788 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32132.log.gz 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33700.log 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.32805.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33025.log 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33700.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33700.log.gz 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30336.log 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32724.log 2024-08-15T17:57:43.789 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.33025.log.gz--verbose 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.30120.log 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30336.log: /var/log/ceph/ceph-client.admin.32724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29327.log 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30336.log.gz 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32724.log.gz 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30120.log: /var/log/ceph/ceph-client.admin.29327.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29327.log.gz 2024-08-15T17:57:43.790 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30120.log.gz 2024-08-15T17:57:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34796.log 2024-08-15T17:57:43.794 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24392.log 2024-08-15T17:57:43.794 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.24256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30171.log 2024-08-15T17:57:43.794 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24256.log.gz 2024-08-15T17:57:43.795 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.24392.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24392.log.gz 2024-08-15T17:57:43.795 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-15T17:57:43.795 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.30171.log: 95.4% -- replaced with /var/log/ceph/ceph-client.1.30171.log.gz 2024-08-15T17:57:43.795 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24336.log 2024-08-15T17:57:43.799 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.log: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-15T17:57:43.799 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-15T17:57:43.800 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.24336.log: 92.2% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.24336.log.gz 2024-08-15T17:57:43.800 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-15T17:57:43.800 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24282.log 2024-08-15T17:57:43.812 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.4.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-15T17:57:43.812 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24364.log 2024-08-15T17:57:43.813 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.24282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24206.log 2024-08-15T17:57:43.813 INFO:teuthology.orchestra.run.smithi105.stderr: 88.3%/var/log/ceph/ceph-client.admin.24364.log: -- replaced with /var/log/ceph/ceph-client.admin.24282.log.gz 2024-08-15T17:57:43.813 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24364.log.gz 2024-08-15T17:57:43.813 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-15T17:57:43.813 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.24206.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24206.log.gz 2024-08-15T17:57:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.7.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24315.log 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32416.log 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30116.log 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.24315.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34796.log.gz 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24315.log.gz 2024-08-15T17:57:43.851 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32416.log.gz 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33376.log 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30116.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30116.log.gz 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31642.log 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.33376.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24055.log 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2024-08-15T17:57:43.852 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31642.log.gz 2024-08-15T17:57:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.24055.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24055.log.gz 2024-08-15T17:57:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30545.log 2024-08-15T17:57:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34321.log 2024-08-15T17:57:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33970.log: /var/log/ceph/ceph-client.admin.30545.log: 95.3% -- replaced with /var/log/ceph/ceph-client.0.33376.log.gz 2024-08-15T17:57:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30546.log 2024-08-15T17:57:43.853 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30545.log.gz 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34321.log.gz 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30546.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30546.log.gz 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31669.log 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31064.log 2024-08-15T17:57:43.854 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31669.log: /var/log/ceph/ceph-client.admin.31064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34850.log 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31669.log.gz 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31064.log.gz 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-15T17:57:43.855 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34850.log: /var/log/ceph/ceph-client.admin.29876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35039.log 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34850.log.gz 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32227.log 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30331.log 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35039.log.gz 2024-08-15T17:57:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29849.log 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8%/var/log/ceph/ceph-client.admin.30331.log: -- replaced with /var/log/ceph/ceph-client.admin.32227.log.gz 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32516.log 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30331.log.gz 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29849.log.gz 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29590.log 2024-08-15T17:57:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34078.log 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32516.log.gz 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29590.log: gzip 93.4%-5 --verbose -- replaced with /var/log/ceph/ceph-mgr.y.log.gz-- 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30544.log 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34078.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29590.log.gz 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33482.log 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34078.log.gz 2024-08-15T17:57:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35120.log 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35174.log /var/log/ceph/ceph-client.admin.33482.log: 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30544.log.gz 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31037.log 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35120.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33482.log.gz 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29984.log 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35120.log.gz 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35174.log.gz 2024-08-15T17:57:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30552.log 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31037.log: /var/log/ceph/ceph-client.admin.29984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31037.log.gz 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29984.log.gz 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30332.log 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30552.log.gz 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32778.log 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33214.log 2024-08-15T17:57:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30332.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gz 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30330.log 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32778.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30332.log.gz 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31561.log 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33214.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32778.log.gz 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30551.log 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30330.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33214.log.gz 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31091.log 2024-08-15T17:57:43.861 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30330.log.gz 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31561.log.gz 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19193.log 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30551.log: /var/log/ceph/ceph-client.admin.31091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29766.log 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30551.log.gz 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31091.log.gz 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-08-15T17:57:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.tmp-client.admin.19193.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19193.log.gz 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30119.log 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29766.log: /var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29766.log.gz 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29536.log 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30119.log: /var/log/ceph/ceph-client.admin.35066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34402.log 2024-08-15T17:57:43.863 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30119.log.gz 2024-08-15T17:57:43.864 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-08-15T17:57:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-15T17:57:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30929.log 2024-08-15T17:57:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34402.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29536.log.gz 2024-08-15T17:57:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph.audit.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-08-15T17:57:43.864 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34402.log.gz 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29563.log 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.30929.log.gz 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.31777.log 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32886.log: /var/log/ceph/ceph-client.admin.29563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31145.log 2024-08-15T17:57:43.865 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29563.log.gz 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34429.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.31777.log.gz 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.33596.log 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33623.log 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29683.log 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33187.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33596.log.gz 2024-08-15T17:57:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31696.log 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.31145.log.gz 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34742.log 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33623.log.gz 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29683.log: /var/log/ceph/ceph-client.admin.31696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31615.log 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29683.log.gz 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34742.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.31696.log.gz 2024-08-15T17:57:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.34742.log.gz-5 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.31966.log 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31615.log: /var/log/ceph/ceph-client.admin.33808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29957.log 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31615.log.gz 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30902.log 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31966.log: gzip /var/log/ceph/ceph-client.admin.29957.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31966.log.gz 2024-08-15T17:57:43.868 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31588.log 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4%/var/log/ceph/ceph-client.admin.30902.log: -- replaced with /var/log/ceph/ceph-client.admin.29957.log.gz 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32543.log 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30902.log.gz 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30767.log 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31588.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29930.log 2024-08-15T17:57:43.869 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31588.log.gz 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32543.log.gz 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33754.log 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30767.log: /var/log/ceph/ceph-client.admin.29930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32362.log 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30767.log.gz 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.29930.log.gz 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.34240.log 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33754.log: /var/log/ceph/ceph-client.admin.32362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29509.log 2024-08-15T17:57:43.870 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33754.log.gz 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.34240.log: 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.32362.log.gz--verbose 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.32078.log 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34375.log 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29509.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34240.log.gz 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29737.log 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29509.log.gz 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32078.log.gz 2024-08-15T17:57:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30118.log 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34375.log.gz 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29482.log 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32308.log 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29737.log.gz 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29793.log 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29482.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30118.log.gz 2024-08-15T17:57:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32308.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29482.log.gz 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32308.log.gz 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31010.log 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34213.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29793.log.gz 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33079.log 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-08-15T17:57:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29427.log 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31010.log.gz 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33079.log.gz 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33889.log: /var/log/ceph/ceph-client.admin.29427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33241.log 2024-08-15T17:57:43.874 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30821.log 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29427.log.gz 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32641.log: /var/log/ceph/ceph-client.admin.33241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33997.log 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33241.log.gz 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30821.log: /var/log/ceph/ceph-client.admin.33997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30848.log 2024-08-15T17:57:43.875 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30821.log.gz 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31831.log 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.1.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33997.log.gz 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33943.log 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31993.log 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31831.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30848.log.gz 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30956.log 2024-08-15T17:57:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33943.log: 88.9%/var/log/ceph/ceph-client.admin.31993.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.31831.log.gz 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.32254.log 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33943.log.gz 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31993.log.gz 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31804.log 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34267.log 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32254.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30956.log.gz 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34051.log 2024-08-15T17:57:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31804.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32254.log.gz 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30011.log 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34267.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35201.log 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34267.log.gz 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33268.log 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34051.log.gz 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31360.log 2024-08-15T17:57:43.878 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30011.log.gz 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33268.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35201.log.gz 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35093.log 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35093.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.33268.log.gz 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31360.log.gz 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35012.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35093.log.gz 2024-08-15T17:57:43.879 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34823.log 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32443.log 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34823.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34823.log.gz 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-08-15T17:57:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30038.log 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30525.log 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32443.log.gz 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34132.log: /var/log/ceph/ceph-client.admin.30038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34877.log 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32200.log 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30525.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30038.log.gz 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32105.log 2024-08-15T17:57:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34877.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30525.log.gz 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33509.log 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34877.log.gz 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32200.log.gz 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32105.log.gz 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 /var/log/ceph/ceph-client.admin.33509.log: --verbose -- /var/log/ceph/ceph-client.admin.32020.log 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33160.log 2024-08-15T17:57:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33455.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33509.log.gz 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 /var/log/ceph/ceph-client.admin.32020.log: --verbose -- /var/log/ceph/ceph-client.admin.32942.log 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33160.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32020.log.gz 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30794.log 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32942.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33160.log.gz 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30335.log 2024-08-15T17:57:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34931.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32942.log.gz 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33569.log 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30794.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31310.log 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30335.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30794.log.gz 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32971.log 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33569.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30335.log.gz 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.31310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-08-15T17:57:43.884 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33569.log.gz 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.32971.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31723.log 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34483.log 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32971.log.gz 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.31310.log.gz 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31723.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34483.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31723.log.gz 2024-08-15T17:57:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 88.9%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.34483.log.gz-5 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.33106.log 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31118.log 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33106.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31118.log: gzip -5 --verbose -- 84.5%/var/log/ceph/ceph-client.admin.29710.log -- replaced with /var/log/ceph/ceph.log.gz 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-08-15T17:57:43.886 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33106.log.gz 2024-08-15T17:57:43.887 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29454.log 2024-08-15T17:57:43.887 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34715.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31118.log.gz 2024-08-15T17:57:43.887 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-15T17:57:43.887 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29710.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-08-15T17:57:43.887 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 /var/log/ceph/ceph-client.admin.29454.log: --verbose -- /var/log/ceph/ceph-client.admin.31750.log 2024-08-15T17:57:43.887 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29710.log.gz 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34510.log 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.0.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29454.log.gz 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32832.log 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34510.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31750.log.gz 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34510.log.gz 2024-08-15T17:57:43.888 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30114.log 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32832.log.gz 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32173.log: /var/log/ceph/ceph-client.admin.32389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34607.log 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 /var/log/ceph/ceph-client.admin.30114.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.33835.log 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34607.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30114.log.gz 2024-08-15T17:57:43.889 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.34688.log 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34607.log.gz 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31201.log 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33835.log.gz 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32478.log 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30329.log 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31201.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34688.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30740.log 2024-08-15T17:57:43.890 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32478.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31201.log.gz 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34958.log 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30329.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32478.log.gz 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30740.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30329.log.gz 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29270.log 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30740.log.gz 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34186.log 2024-08-15T17:57:43.891 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33727.log 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34958.log.gz 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29648.log 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34186.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29270.log.gz 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33727.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34186.log.gz 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33781.log 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33727.log.gz 2024-08-15T17:57:43.892 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31885.log 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29648.log.gz 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30333.log 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33781.log: /var/log/ceph/ceph-client.admin.31885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29619.log 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33781.log.gz 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31858.log 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31885.log.gz 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30333.log.gz 2024-08-15T17:57:43.893 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33428.log 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29619.log.gz 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.31858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33133.log 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31858.log.gz 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33428.log: /var/log/ceph/ceph-client.admin.33133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33428.log.gz 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30106.log 2024-08-15T17:57:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32668.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33133.log.gz 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30334.log 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4%/var/log/ceph/ceph-client.admin.34294.log: -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30106.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30106.log.gz 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29822.log 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33650.log 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33862.log 2024-08-15T17:57:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.29822.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30334.log.gz 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33650.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29822.log.gz 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33862.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33650.log.gz 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33862.log.gz 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.31454.log 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32051.log 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.2.31454.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34661.log 2024-08-15T17:57:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32051.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32051.log.gz 2024-08-15T17:57:43.897 INFO:teuthology.orchestra.run.smithi033.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.2.31454.log.gz 2024-08-15T17:57:43.897 INFO:teuthology.orchestra.run.smithi105.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-15T17:57:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32576.log 2024-08-15T17:57:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30529.log 2024-08-15T17:57:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32576.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34661.log.gz 2024-08-15T17:57:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.30529.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32576.log.gz 2024-08-15T17:57:43.899 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30529.log.gz 2024-08-15T17:57:43.925 INFO:teuthology.orchestra.run.smithi105.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-15T17:57:43.945 INFO:teuthology.orchestra.run.smithi105.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-15T17:57:43.959 INFO:teuthology.orchestra.run.smithi105.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-15T17:57:43.985 INFO:teuthology.orchestra.run.smithi033.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-15T17:57:43.988 INFO:teuthology.orchestra.run.smithi105.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-15T17:57:44.000 INFO:teuthology.orchestra.run.smithi033.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-15T17:57:44.001 INFO:teuthology.orchestra.run.smithi033.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-15T17:57:44.009 INFO:teuthology.orchestra.run.smithi105.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-15T17:57:44.012 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-08-15T17:57:44.012 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m0.266s 2024-08-15T17:57:44.012 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m1.138s 2024-08-15T17:57:44.012 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m0.055s 2024-08-15T17:57:44.057 INFO:teuthology.orchestra.run.smithi033.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-15T17:57:44.073 INFO:teuthology.orchestra.run.smithi033.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-15T17:57:44.075 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-08-15T17:57:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m0.332s 2024-08-15T17:57:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:user 0m1.214s 2024-08-15T17:57:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m0.099s 2024-08-15T17:57:44.076 INFO:tasks.ceph:Archiving logs... 2024-08-15T17:57:44.076 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/remote/smithi033/log 2024-08-15T17:57:44.077 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-15T17:57:44.458 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/remote/smithi105/log 2024-08-15T17:57:44.459 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-15T17:57:44.639 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-15T17:57:44.666 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-15T17:57:44.666 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-15T17:57:44.669 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-15T17:57:44.729 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-15T17:57:44.738 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-15T17:57:44.738 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-15T17:57:44.740 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-15T17:57:44.764 INFO:teuthology.orchestra.run.smithi033.stdout: remote refid st t when poll reach delay offset jitter 2024-08-15T17:57:44.764 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================== 2024-08-15T17:57:44.764 INFO:teuthology.orchestra.run.smithi033.stdout:+hv01.front.sepi 67.205.162.81 3 u 51 64 177 0.094 -0.872 0.540 2024-08-15T17:57:44.764 INFO:teuthology.orchestra.run.smithi033.stdout:+hv02.front.sepi 96.245.170.99 3 u 54 64 177 0.062 1.465 0.846 2024-08-15T17:57:44.764 INFO:teuthology.orchestra.run.smithi033.stdout:*hv03.front.sepi 74.6.168.72 3 u 58 64 177 0.101 0.700 0.523 2024-08-15T17:57:44.764 INFO:teuthology.orchestra.run.smithi033.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:57:44.766 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2024-08-15T17:57:44.766 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2024-08-15T17:57:44.766 INFO:teuthology.orchestra.run.smithi105.stdout:+hv01.front.sepi 67.205.162.81 3 u 53 64 177 0.079 -1.158 0.491 2024-08-15T17:57:44.767 INFO:teuthology.orchestra.run.smithi105.stdout:*hv02.front.sepi 96.245.170.99 3 u 51 64 177 0.090 0.470 0.661 2024-08-15T17:57:44.767 INFO:teuthology.orchestra.run.smithi105.stdout:+hv03.front.sepi 74.6.168.72 3 u 47 64 177 0.087 1.210 0.686 2024-08-15T17:57:44.767 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-15T17:57:44.767 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-15T17:57:44.829 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-15T17:57:44.829 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-15T17:57:44.839 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-15T17:57:44.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-15T17:57:44.857 INFO:teuthology.task.internal:Duration was 792.937710 seconds 2024-08-15T17:57:44.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-15T17:57:44.867 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-15T17:57:44.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-15T17:57:44.869 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-15T17:57:44.918 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-15T17:57:44.918 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-08-15T17:57:44.918 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-15T17:57:44.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-08-15T17:57:44.931 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-15T17:57:44.943 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-15T17:57:44.944 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-15T17:57:44.946 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-15T17:57:44.982 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-15T17:57:44.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-15T17:57:44.984 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-15T17:57:45.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-15T17:57:45.108 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-15T17:57:45.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-15T17:57:45.126 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-15T17:57:45.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-15T17:57:45.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-15T17:57:45.169 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-15T17:57:45.181 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-08-15T17:57:45.199 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-08-15T17:57:45.215 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-15T17:57:45.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:57:45.223 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-15T17:57:45.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-15T17:57:45.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-15T17:57:45.238 INFO:teuthology.task.internal:Transferring archived files... 2024-08-15T17:57:45.240 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/remote/smithi033 2024-08-15T17:57:45.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-15T17:57:45.288 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-15_16:39:12-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7857029/remote/smithi105 2024-08-15T17:57:45.288 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-15T17:57:45.313 INFO:teuthology.task.internal:Removing archive directory... 2024-08-15T17:57:45.314 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-15T17:57:45.316 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-15T17:57:45.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-15T17:57:45.371 INFO:teuthology.task.internal:Not uploading archives. 2024-08-15T17:57:45.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-15T17:57:45.381 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-15T17:57:45.381 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-15T17:57:45.385 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-15T17:57:45.389 INFO:teuthology.orchestra.run.smithi033.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 15 17:57 /home/ubuntu/cephtest 2024-08-15T17:57:45.393 INFO:teuthology.orchestra.run.smithi105.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 15 17:57 /home/ubuntu/cephtest 2024-08-15T17:57:45.395 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-15T17:57:45.406 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-15T17:57:45.430 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 792.9377100467682 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f62160b82d2e4310aa75ebacbd056be3 status: fail success: false 2024-08-15T17:57:45.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-15T17:57:45.511 INFO:teuthology.run:FAIL